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Executive  Summary 


If  it  is  to  continue  as  die  world's  preeminent  engineering  and  design  organi¬ 
zation,  the  U.S.  Army  Corps  of  Engineers  (USACE)  must  fulfill  its  customers' 
demand  for  total  quality  products  and  excellent  service.  To  Corps  customers  to¬ 
tal  quality  means  engineering  and  design  products  that  meet  their  functional 
and  technical  requirements,  are  completed  on  schedule  and  within  the  given 
budget,  and  are  delivered  with  exceptional  customer  service.  In  response  to  its 
customer's  challenges,  USACE  has  already  launched  several  quality-related  ini¬ 
tiatives  (e.g..  Total  Army  Quality).  However,  those  quality  initiatives,  as  a  whole, 
could  be  much  more  beneficial  to  the  field  activities  implementing  them  if  they 
were  made  part  of  a  broader  and  integrated  quality  management  system  that 
would  minimize  lapses  in  quality  by  preventing  most  problems.  When  prob¬ 
lems  do  arise,  the  system  quickly  identifies  and  corrects  the  faulty  systems  or 
procedures.  Fortunately  for  USACE,  a  ready  recipe  for  acceptable  quality  man¬ 
agement  systems  —  the  ISO  9000  quality  system  standards  —  already  exists. 

The  ISO  9000  standards,  developed  by  the  International  Organization  for 
Standards,  are  a  series  of  generic  quality  system  criteria  that  provide  the  funda¬ 
mental  framework  for  universally  accepted  quality  management  systems  and 
establish  the  basic  elements  that  comprise  those  systems.  The  European  Eco¬ 
nomic  Community  is  already  using  ISO  9000  to  verify  die  legitimacy  of  quality 
systems  across  national  boundaries.  In  the  United  States,  ISO  registration  is 
growing  rapidly  because  in  certain  industries,  registration  to  ISO  9000  is  contrac¬ 
tually  mandated  or  part  of  contractor  selection  criteria.  For  other  quality- 
conscious  firms,  ISO  standards  offer  a  ready  model  for  improving  internal  qual¬ 
ity  systems  and  therefore,  efficiency,  competitiveness,  and  productivity.  Most 
registered  companies  are  finding  that  the  benefits  of  registering  under  ISO  ex¬ 
ceed  the  costs. 

Currently,  engineering  processes  at  USACE  field  activities  do  not  meet  the 
minimum  quality  system  standards  set  forth  by  ISO  9000.  Those  field  activities 
can  remedy  their  quality  system  shortfalls  by  adhering  to  the  basic  tenets  of  the 
ISO  9000  quality  system  standards,  thereby  increasing  productivity,  improving 
product  quality,  raising  customer  satisfaction,  acquiring  competitive  advan¬ 
tages,  motivating  employees,  and,  perhaps  most  importantly,  gaining  recogni¬ 
tion  as  a  legitimate  quality  leader  in  the  engineering  industry.  While  this  study 
focused  primarily  on  USACE's  engineering  activities,  the  benefits  of  registration 
are  maximized  when  all  major  elements  of  the  project  delivery  process  are 
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included  within  the  scope  of  registration.  The  ultimate  goal  of  field  activities  im¬ 
plementing  ISO  9000  should  be  focused  on  the  entire  project  delivery  process. 

We  believe  that  USACE  field  activities  will  accrue  benefits  similar  to  those 
experienced  by  die  private  sector,  but  we  recommend  the  Corps  take  a  meas¬ 
ured  approach  to  adopting  the  ISO  9000  standards.  The  following  recommenda¬ 
tions  offer  USACE  a  strategy  for  adopting  and  becoming  registered  to  the  ISO 
9000  standards. 

♦  Headquarters,  USACE,  should  select  two  to  four  field  activities  to  evaluate  the 
costs  and  benefits  of  ISO  9000  registration.  Several  USACE  field  activities  have 
already  expressed  interest  in  ISO.  HQUSACE  should  encourage  their  regis¬ 
tration  by  sharing  the  development  and  documentation  of  ISO-qualified 
processes  and  ISO-awareness  training.  At  the  same  time,  HQUSACE 
should  develop  a  test  implementation  strategy  and  establish  the  criteria  that 
will  define  its  success.  The  plan  should  include  a  strategy  for  expanding 
registration  beyond  engineering  and  beyond  the  minimum  quality  system 
requirements  established  by  the  ISO  standards. 

♦  The  USACE  should  encourage  all  its  field  activities  to  seek  ISO  9000  registration  if 
the  test  site  results  justify  it.  The  benefits  of  adopting  die  ISO  quality  stan¬ 
dards  are  maximized  when  the  leadership  at  the  field  activities  is  commit¬ 
ted  to  quality  improvement  HQUSACE  should  promote  the  program 
throughout  its  network  of  field  activities  and  provide  the  needed  ISO 
awareness  and  implementation  guidance.  Procedure  and  documentation 
templates  from  the  test  sites  will  help  minimize  costs  for  all  subsequent  reg¬ 
istrations.  Recognition  and/or  award  incentives  will  further  foster  the 
needed  internal  commitment 

♦  The  USACE  should  take  a  leadership  role  in  the  engineering  community  and  en¬ 
courage  its  architectural  and  engineering  contractors  to  pursue  ISO  registration. 
A  contractor  selection  process  that  encourages  its  suppliers  to  register  un¬ 
der  ISO  9000  will  improve  the  quality,  costs,  and  timeliness  of  the  engineer¬ 
ing  products  the  Corps  receives.  While  registration  to  ISO  should  not  be 
required  at  this  time,  it  can  be  used  in  lieu  of  or  in  conjunction  with  other 
USACE  quality  requirements  during  the  acquisition  process.  The  ISO  qual¬ 
ity  system  requirement  can  be  advertised  during  contractor  selection,  will 
help  to  promulgate  total  quality  ideals  in  the  engineering  community,  and 
will  simplify  the  process  for  evaluating  the  contractors'  quality-control 
plans. 

USACE's  customers  will  continue  to  demand  higher  levels  of  quality  and 
excellent  service.  Improving  the  total  quality  of  its  processes  and  assuring  the 
total  quality  of  the  products  it  receives  from  its  suppliers  is  a  way  for  the 
USACE  to  foster  a  world-class  engineering  reputation  and  meet  the  increased 
needs  of  its  customers. 
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Chapter  1 

Introduction 


Background 

With  an  annual  engineering  and  design  program  of  about  $700  million,  the 
US.  Army  Corps  of  Engineers  (USACE)  is  the  worlds  largest  engineering  enter¬ 
prise.  Managing  USACE's  engineering  activity  is  a  demanding  task,  and  major 
challenges  must  be  faced  if  it  is  going  to  continue  delivering  the  type  of  engineer¬ 
ing  and  design  products  that  its  customers  expect  In  die  past  customers  came 
to  die  Corps  because  it  had  engineering  expertise  that  few  others  possessed.  To¬ 
day,  die  business  environment  is  changing  —  at  die  same  time  USACE's  funding 
is  shrinking,  its  customers  are  demanding  die  same  quality  products  but  with 
better  services  and  a  growing  number  of  its  customers  are  finding  other  ways  to 
acquire  some  services  that  previously  only  USACE  could  deliver.  USACE's  cus¬ 
tomers  want  total  quality  —  engineering  and  design  products  that  meet  their 
specific  functional  and  operational  requirements,  are  completed  on  schedule,  sat¬ 
isfy  environmental  concerns,  meet  safety  requirements,  and  are  cost-effective  to 
construct;  operate,  and  maintain.  Its  customers  also  want  die  Corps  to  provide 
exceptional  service  and  they  want  assurance  in  advance  that  die  total  quality 
they  want  is  the  quality  they  will  get  USACE  must  find  new  and  innovative 
ways  to  meet  its  customers  changing  expectations  for  high-quality  products  and 
excellent  service. 

Quality  and  customer  service  are  not  new  concepts  in  die  Corps,  and  current 
quality-related  initiatives  would  suggest  a  growing  commitment  to  total  quality 
and  to  service  excellence.  The  Corps  recognizes  that  its  business  environment  is 
evolving  and  that  is  must  now  compete  with  other  Federal  agencies  and  private- 
sector  contractors  for  certain  portions  of  its  engineering  program.  Establishing 
and  maintaining  a  competitive  posture  means  USACE  must  continually  improve 
its  internal  operations  to  remain  a  cost-effective  choice  for  its  customers.  Proof  of 
USACE's  commitment  can  be  found  in  its  recently  issued  quality  policy: 


...  to  deliver  excellent  engineering  and  de¬ 
sign  services  and  products  to  customers  on 
schedule  and  within  budget . . . 


Quality  and  quality  management  are  becoming  major  issues  in  a  number  of 
USACE's  current  initiatives.  For  example,  the  USACE  is  currently  implementing 
Total  Army  Quality  (TAQ),  which  is  its  internal  response  to  Dob's  call  for  total 
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quality  management  (TQM).  TAQ  is  intended  to  improve  USACE's  quality  man¬ 
agement  by  strengthening  its  current  quality  policies,  examining  alternative 
methods  of  incorporating  quality  into  its  processes,  and  developing  training  and 
monitoring  systems  to  continually  improve  its  processes  at  all  levels  of  the  or¬ 
ganization.  A  recent  memorandum  from  the  Chief  of  Engineers  (see 
Appendix  A)  has  made  it  clear  that  quality  initiatives  such  as  TAQ  are  important 
to  toe  future  success  of  USACE  in  its  current  and  expanding  markets.  At  this 
time,  TAQ  is  not  mandatory;  however,  it  is  being  implemented  on  a  voluntary 
basis  at  a  number  of  USACE  field  activities  that  expect  it  to  deliver  tangible  bene¬ 
fits.  TAQ,  which  is  prescribed  by  Army  Regulation  (AR)  5-1,  Army  Management 
Philosophy,  dated  12  June  1992,  is  described  in  further  detail  in  toe  Army  publica¬ 
tion  Leadership  for  Total  Army  Quality  Concept  Plan. 

In  addition  to  TAQ,  USACE  is  developing  and  implementing  several  auto¬ 
mated  systems  to  improve  such  processes  as  design  reviews  and  approvals  and 
contractor  selection,  for  example.  Further  proof  of  USACE's  commitment  to 
quality  can  be  found  in  its  recently  released  quality  doctrine.  Engineering  Regu¬ 
lation  (ER)  1110-1-12,  Engineering  and  Design  Quality  Management.  That  ER  spells 
out  USACE's  commitment  to  quality  and  its  strategy  for  improving  customer 
service  and  products  for  empowering  its  employees,  and  for  continually  improv¬ 
ing  its  operations. 

In  the  field,  USACE's  engineering  organizations  are  searching  for  the  right 
blend  of  new  and  traditional  quality  management  initiatives  that  will  ultimately 
improve  their  operations,  engineering  products,  competitive  posture,  and  cus¬ 
tomer  service.  Some  field  activities  have  turned  to  ER  1110-1-12  and  TAQ  and 
found  that  TQM  is  difficult  to  implement  and  does  not  automatically  solve  all 
their  problems.  What  they  find  lacking  is  an  overall  quality  management  frame¬ 
work  and  systematic  methodology  for  instituting  quality  management  funda¬ 
mentals  in  engineering  activities. 

One  way  for  USACE  to  establish  that  rudimentary  quality  management  sys¬ 
tem  is  to  adopt  the  basic  elements  of  proven  quality  management  systems  from 
private  industry  and/  or  other  government  agencies.  Experts  agree  that  the  fun¬ 
damental  elements  and  structure  of  what  comprises  an  acceptable  quality  man¬ 
agement  system  are  well-established,  have  been  used  and  improved  by  many 
successful  organizations  throughout  toe  world,  and  fortunately  for  USACE,  have 
now  been  standardized  and  published  by  the  International  Organization  for 
Standards  as  the  ISO  90001  quality  management  series. 

The  ISO  90002  quality  standards  are  currently  being  used  by  the  European 
Economic  Community  (EEC)  to  gauge  the  acceptability  of  quality  systems  of  the 

’ISO  is  not  an  acronym  for  the  International  Organization  for  Standards  as  com¬ 
monly  believed,  but  rather  it  simply  refers  to  the  Latin  prefix  "ISO,"  which  means  equal. 

2  In  the  United  States,  toe  ISO  9000  standards  have  been  adopted  as  the  American  Na¬ 
tional  Standards  Institute  (ANSI)  and  the  American  Society  for  Quality  Control 
Q90-series  standards.  Except  for  some  changes  in  nomenclature,  toe  two  sets  of  quality 
standards  are  technically  identical.  For  toe  sake  of  simplicity,  in  this  report,  we  use  "ISO 
9000"  to  refer  to  both  sets  of  recognized  quality  system  standards. 
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many  different  companies  from  different  countries  that  want  to  do  business 
within  the  EEC.  The  ISO  9000  quality  system  standards  merely  describe  the 
minimum  requirements  for  an  effective  and  legitimate  quality  management  sys¬ 
tem  within  any  organization.  Those  requirements  are  nothing  more  than  a  set  of 
common  sense  rules  and  procedures  that  together  govern  the  way  an  organiza¬ 
tion  should  manage  quality  so  that  it  produces  products  or  services  that  meet  its 
customer's  demands.  ISO  9000's  main  objective  is  quality  assurance  —  not  qual¬ 
ity  control.  Compliance  with  the  ISO  9000  quality  standards  is  intended  to  give 
an  organization's  customers  a  level  of  assurance  that  the  organization  will  be  ca¬ 
pable  of  consistently  delivering  quality  products  and  services.  The  organization 
does  that  by  continually  gauging  the  compliance  of  its  quality  systems  against 
the  established  ISO  9000  standards,  and  outside  auditors  periodically  confirm  the 
compliance  of  their  quality  management  system.  The  ISO  standards  do  not  man¬ 
date  how  an  organization  should  produce  its  product  or  services  but  only  what 
its  quality  objectives  and  processes  should  do. 

The  use  of  the  ISO  9000  quality  standards  is  currently  spreading  rapidly 
throughout  the  world  and  is  quickly  becoming  the  single  world  quality  manage¬ 
ment  standard.  Complying  with  the  ISO  9000  quality  standards  is  a  tangible  ex¬ 
pression  of  an  organization's  commitment  to  quality  that  rests  on  internationally 
recognized  quality  principles.  Should  USACE  Held  activities  adopt  all  or  a  por¬ 
tion  of  the  190  9000  or  similar  type  standards?  Should  USACE  field  activities  be¬ 
come  registered  under  an  ISO- type  quality  system?  Should  USACE  require  its 
contractors  to  become  registered?  Those  questions  are  answered  in  this  report. 


Study  Approach 

The  USACE  Directorate  of  Military  Programs,  Engineering  Division,  asked 
Logistics  Management  Institute  to  examine  existing  quality  management  system 
standards  and  to  determine  whether  adopting  one  like  ISO  9000  makes  sense  for 
its  engineering  and  design  organizations  at  the  division  and  district  levels.  The 
goal  is  to  determine  whether  ISO-type  standards  provide  a  ready  mechanism  for 
improving  quality  management  systems  internally  or  for  improving  the  quality, 
timeliness,  and/or  costs  of  the  products  USACE  receives  from  outside  architect¬ 
engineering  (A-E)  contractors. 

In  this  study,  we  developed  a  thorough  understanding  of  the  ISO  9000  stan¬ 
dards,  other  quality  management  standards,  and  USACE's  TAQ  initiative  by  in¬ 
terviewing  key  USACE  personnel  and  industry  experts  and  researching  relevant 
literature  and  engineering  publications.  At  the  same  time,  we  identified  and  in¬ 
terviewed  several  private-sector  engineering  and  design  firms  that  had  already 
registered  with  ISO  9000  so  that  we  could  learn  why  they  did  so,  what  benefits 
they  received,  what  it  cost  to  implement,  what  barriers  they  experienced  during 
the  process,  and  what  impact  they  expect  their  registrations  to  have  on  the  re¬ 
quirements  for  quality  system  registration  of  their  suppliers.  We  used  a  survey 
conducted  by  Deloitte  &  Touche,  Inc.,  and  the  Quality  Systems  Update  Newsletter 
(an  ISO  9000  industry  publication)  in  July  1993  to  gain  needed  insights  into  the 
community  of  ISO-registered  firms.  The  survey  questionnaire  was  sent  to  all 


1-3 


1,679  firms  registered  in  the  United  States  at  that  time  (today,  the  number  ex¬ 
ceeds  2,200),  and  620  firms  responded;  about  150  of  the  responding  firms  had  an¬ 
nual  sales  in  excess  of  $500  million. 

From  that  independent  research  and  from  site  visits,  we  developed  a  frame¬ 
work  for  implementing  ISO  9000-type  quality  standards  at  USACE  field  activi¬ 
ties  to  determine  the  impact  those  standards  would  have,  to  evaluate  the  success 
of  other  current  quality  initiatives,  to  determine  whether  those  quality  initiatives 
meet  the  intent  of  the  ISO  quality  standards,  and  to  assess  the  extent  to  which  die 
ISO  standards  should  be  adopted.  We  also  examined  the  possibility  and  reason¬ 
ableness  of  requiring  all  or  some  of  USACE's  suppliers  and  A-E  contractors  to  be 
ISO  9000  registered.  Registration  to  ISO  9000  could  eventually  be  required  by 
USACE's  customers  or  it  could  simply  be  a  way  to  improve  productivity  in 
USACE's  engineering  and  design  operations.  We  identify  the  likely  costs  and 
benefits  to  USACE  along  with  our  recommended  course  of  action  and  future  im¬ 
plementation  strategy. 


Report  Organization 

The  remainder  of  this  report  provides  the  results  of  our  investigation  of  the 
ISO  9000  quality  standards  and  our  conclusions  and  recommendations  that  fol¬ 
low  from  those  results.  Chapter  2  presents  an  overview  of  the  ISO  9000  stan¬ 
dards,  describes  the  reasons  most  companies  in  private  industry  and  the  design 
and  construction  industry  in  particular  choose  to  become  registered,  outlines  the 
potential  benefits  that  quality  systems  and  ISO  registration  bring  to  an  organiza¬ 
tion,  establishes  the  costs  for  implementing  and  maintaining  ISO  registration, 
and  discusses  the  major  barriers  to  complying  with  them.  The  chapter  also 
shows  the  major  trends  occurring  in  private  industry  and  the  impacts  those 
trends  have  on  USACE's  quality  requirements.  For  example,  die  chapter  dis¬ 
cusses  whether  USACE  customers  will  eventually  require  their  suppliers  to  be 
ISO  registered  as  a  prerequisite  to  doing  business  and  what  other  engineering 
and  construction  firms  are  doing  with  respect  to  ISO  registration.  In  Chapter  3, 
USACE's  current  quality  systems  and  initiatives,  like  TAQ,  are  examined  and 
compared  to  the  requirements  of  the  ISO  9000  standards  to  determine  whether 
any  satisfy  the  intent  of  the  ISO  quality  standards.  Finally,  in  Chapter  4,  we  pre¬ 
sent  our  conclusions  about  the  ISO  standards,  their  impact  on  USACE  opera¬ 
tions,  and  our  recommendations  for  their  adoption  within  USACE. 


1-4 


Chapter  2 


Quality  Management  Using 
the  ISO  9000  Standards 


Introduction 

Quality,  for  the  most  part,  is  what  the  customer  says  it  is.  To  USACE's  cus¬ 
tomers  (internal  and  external),  quality  means  that  die  engineering  and  design 
products  they  purchase  meet  their  functional  and  technical  requirements  and  are 
delivered  on  schedule  and  within  a  competitive  cost  —  USACE's  customers 
want  total  quality.  To  ensure  they  get  what  they  want  customers  oftentimes 
prepare  written  specifications  that  detail  what  die  end  product  should  be  or 
should  do  and  sometimes  even  how  it  should  be  done  —  that  activity  is  called 
quality  assurance.  The  mere  fact  that  those  requirements  are  prepared  and  writ¬ 
ten,  however,  is  no  guarantee  they  will  be  met  by  the  supplier. 

Most  organizations  want  to  stay  in  business.  To  do  that  in  today's 
customer-focused  environment,  suppliers  and  service  providers  are  making  sure 
they  understand  their  customers'  requirements  and,  most  importantly,  they  are 
doing  whatever  is  necessary  to  meet  diem.  The  quality  control  mechanisms  that 
organizations  impose  upon  themselves  to  regulate  internal  quality  and  quality 
processes  is  known  as  a  quality  management  system.  The  purpose  of  quality  man¬ 
agement  is  to  make  sure  that  die  customers'  requirements  are  fully  understood, 
die  finished  products  satisfy  those  requirements,  and  the  necessary  feedback  is 
provided  to  the  customers.  In  addition  to  pleasing  customers,  well-grounded 
quality  management  systems  usually  improve  productivity  and  reduce  costs  as¬ 
sociated  with  inefficient  operations  and  wasted  efforts.  The  supplier-process- 
customer  model  shown  in  Figure  2-1  illustrates  quality  systems 

Quality  Quality 


Figure  2-1. 

Basic  Design  of  Effective  Quality  Systems 
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In  die  past  customers  used  quality  control  specifications  (or  military  quality 
specifications  for  DoD  organizations)  to  assure  die  quality  of  the  products  they 
received  from  their  suppliers.  That  procedure,  however,  provided  no  control 
over  the  quality  of  the  process  used  to  deliver  the  product  or  service;  thus,  it  did 
not  ensure  die  quality  of  future  shipments  or  future  services.  Those  quality  con¬ 
trol  inspections  are  expensive  for  both  customers  and  suppliers  alike.  Then,  vi¬ 
sionaries  like  Demin g,  Juran,  Ishakawa,  and  others  claimed  that,  ultimately, 
product  quality  cannot  be  achieved  by  inspecting  and  correcting  it  into  reality 
but  rather,  organizations  need  to  focus  on  understanding  and  improving  the 
systems  and  processes  that  produce  the  product  A  whole  new 
philosophy  —  total  quality  management  —  was  bom.  TQM  relieves  organiza¬ 
tions  of  the  arduous  task  of  quality  control  and  replaces  it  with  a  philosophy 
that  the  process  by  which  products  and  services  are  provided  should  be  right 
the  first  time.  When  quality  management  is  the  foundation  of  the  company, 
quality  is  built  in.  However,  companies  soon  learned  that  TQM  could  not  solve 
all  their  problems,  was  expensive  to  implement,  required  unprecedented  com¬ 
mitment  from  all  employees,  and  oftentimes  failed  for  lack  of  commitment  or  a 
poor  implementation  strategy. 


The  ISO  9000  Quality  Standards 

Today,  organizations  have  a  new  way  of  initiating  quality  management  into 
their  daily  operations  by  adopting  the  ISO  9000  quality  system  standards  (see 
Figure  2-2).  ISO  is  not  TQM,  but  rather  it  is  a  holistic  quality  management 
framework  that  lays  out  the  basics.  The  ISO  standards  are  20  elements  of  good 
quality  management  practice,  and  any  organization  that  successfully  addresses 
those  20  points  has  established  an  acceptable  quality  management  system.  The 
ISO  standards  are  neither  product  specifications  nor  technology  standards;  they 
are  essential  elements  of  good  management  practice  and  focus  on  how  an  or¬ 
ganization  will  consistently  deliver  quality  products  and  services.  Registration 
from  an  external  auditor  confirms  that  the  organization's  quality  system  is  con¬ 
sistent  with  ISO  standards. 


Figure  2-2. 

ISO  9000  is  the  Foundation  of  Quality  Management 
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The  ISO  standards  themselves  are  actually  quite  simple.  Used  internally  as 
a  quality  system  model,  any  company  that  adopts  them  can  safely  say  that  it  has 
a  legitimate  and  documented  quality  system  that  is  fully  implemented  and  con¬ 
sistently  followed.  Used  for  external  quality  assurance,  the  standards  prove  that 
suppliers'  quality  systems  meet  the  rigorous  requirements  of  the  ISO  standards, 
that  the  existence  of  a  quality  system  has  been  verified  by  an  outside  registrar, 
and  therefore,  will  likely  consistently  deliver  the  quality  product  customers 
want  Basically,  the  ISO  standards  require  an  organization  to  put  into  place  a 
quality  management  system  that  does  the  following; 

♦  Documents  what  the  organization  does.  The  organization  must  develop 
and  maintain  documented  procedures  that  show  what  processes  are  used  to 
deliver  its  products  or  services  and  that  demonstrate  how  quality  is  ensured 
and  the  customer's  requirements  are  met  Documentation  provides  the 
needed  evidence  that  all  procedures  that  affect  the  quality  of  a  product  have 
been  thoroughly  addressed  and  planned  (later,  the  documentation  will  be 
used  as  an  integral  part  of  the  audit  process).  The  documentation  should 
include  a  quality  manual  that  serves  as  a  blueprint  for  the  quality  manage¬ 
ment  system  and  lower  level  documentation  for  describing  processes  and 
procedures  (only  those  procedures  directly  affecting  product  quality  need  to 
be  documented). 

♦  Demonstrates  the  organization  actually  does  what  is  documented.  The  or¬ 
ganization  must  prove  (usually  verified  through  observation)  that  the  per¬ 
sonnel  or  systems  responsible  for  executing  those  documented  procedures 
are  doing  so.  Auditors  will  look  for  3  -  6  months  of  evidence  that  the  or¬ 
ganization  has  been  following  its  documented  procedures. 

♦  Measures  and  keeps  accurate  records  of  the  work  that  was  performed.  Or¬ 
ganizations  must  also  prove  that  the  records  are  legitimate  and  that  quality 
has  been  part  of  the  business  over  time.  Part  of  that  "burden  of  proof'  rests 
with  effectively  recording  elements  of  the  business  affecting  the  quality  of 
the  product. 

♦  Evaluates  and  analyzes  the  results.  The  organization  must  establish  a  sys¬ 
tem  for  checking  how  well  the  product  or  service  performs  with  respect  to 
those  documented  procedures  and  customer  requirements.  Results  from 
that  analysis  can  trigger  corrective  actions. 

♦  Corrects  system  deficiencies  and  continually  improves.  The  organization 
must  have  a  system  that  ensures  problems  are  resolved  and  corrective  ac¬ 
tion  is  taken.  When  warranted,  corrective  action  should  update  existing 
procedures  and  the  requisite  documentation  (e.g.,  continuous  improve¬ 
ment).  Continuous  improvement  and  better  processes  and  procedures  are 
areas  where  USACE's  TAQ  and  reengineering  efforts  can  help. 

The  ISO  quality  standards  are  flexible  enough  to  be  used  by  almost  every 
industry  and  enterprise  in  the  private  or  public  sector.  As  a  result,  they  are  hav¬ 
ing  a  significant  impact  on  international  trade  and,  to  date,  almost  all  of  the 
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industrialized  world  (60  countries)  has  adopted  them  as  their  national  standards 
(see  Figure  2-3).  Regional  trading  groups  such  as  the  European  Economic  Com¬ 
munity  (EEC)  are  using  the  ISO  standards  to  establish  uniform  systems  for 
product  standards,  product  certification,  or  quality  system  registration.  Al¬ 
though  no  formal  agreements  have  yet  been  adopted,  the  ISO  standards  are  be¬ 
ing  considered  by  other  trading  partnerships  such  as  the  North  American  Free 
Trade  Agreement  (NAFTA)  and  the  General  Agreement  on  Tariffs  and  Trade 
(GATT). 


Figure  2-3. 

Registered  Companies  in  the  World  Today 


ISO  9000  Architecture 

The  basic  architecture  of  the  ISO  9000  standards  is  a  related  set  of  five  indi¬ 
vidual  documents.  Three  of  them,  ISO  9001,  ISO  9002,  and  ISO  9003,  are  the 
core  quality  conformance  documents  that  external  entities  use  to  verify  the  exis¬ 
tence  of  a  quality  system  and  that  are  used  in  contractual  agreements.  An  or¬ 
ganization  registers  to  the  ISO  standard  that  most  closely  relates  to  the  scope  of 
its  primary  business  processes.  (Additional  material  on  selecting  the  appropri¬ 
ate  standard  is  included  in  the  next  subsection  of  this  chapter.)  The  other  two 
individual  documents,  ISO  9000  and  ISO  9004,  are  supporting  guidelines.  The 
five  documents  are  as  follows: 

♦  ISO  9000  —  Quality  Management  and  Quality  Assurance  Standards:  Guidelines 
for  Selection  and  Use.  This  document  provides  users  with  an  overview  of  the 
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ISO  standards,  key  definitions,  concepts,  and  guidelines  for  selection  of  ei¬ 
ther  the  ISO  9001, 9002,  or  9003  quality  assurance  models. 

♦  ISO  9001  -  Quality  Systems  -  Model  Jor  Quality  Assurance  in  Design / 
Development,  Production,  Installation,  and  Servicing.  As  the  name  implies,  this 
document  is  a  quality  assurance  standard  that  is  used  to  ensure 
conformance  during  design/  development,  production,  installation,  and 
servicing.  It  has  been  developed  for  organizations  with  a  full  range  of 
activities  that  need  to  be  involved  in  the  quality  system. 

4  ISO  9002  —  Quality  Systems  -  Model  for  Quality  Assurance  in  Production  and 
Installation.  This  standard  is  used  when  only  production  and  installation 
functions  are  to  be  monitored. 

♦  ISO  9003  —  Quality  Systems  -  Model  for  Quality  Assurance  in  Final  Inspection 
and  Test.  This  document  is  a  less  restrictive  quality  standard  that  covers 
only  the  inspection  and  testing  of  the  organization's  product 

4  ISO  9004  —  Quality  Management  and  Quality  System  Elements  Guidelines. 
This  document  is  not  a  standard  but  rattier  a  guideline  for  developing  an  in¬ 
ternal  quality  system  to  meet  either  the  ISO  9001, 9002,  or  9003  standards. 

The  ISO  9000  standards  cover  everything  affecting  quality,  but  they  do  not 
proscribe  the  methods,  systems,  or  technology  needed  to  perform  quality  man¬ 
agement  Rather,  the  standards  establish  benchmarks  that  indicate  minimum 
levels  of  acceptance.  Table  2-1  shows  the  20  quality  standards  of  ISO  9001,  the 
most  comprehensive  of  the  three  core  quality  conformance  documents,  along 
with  a  cross-reference  to  ISO  9002  and  9003.  The  actual  ISO  9001  standards  have 
been  reproduced  in  Appendix  B. 


Selecting  the  Appropriate  ISO  Standard 

In  selecting  which  of  the  quality  assurance  models  (9001,  9002,  or  9003)  to 
adopt,  most  organizations  simply  refer  to  the  guidance  found  in  the  ISO  9000 
standard,  which  requires  "systematic  consideration"  of  the  following  six  factors: 

4  Design  process  complexity.  How  difficult  is  the  design  and/or  preliminary 
development  of  the  product  or  service? 

4  Design  maturity.  Is  the  product  developed  uniquely  every  time? 

4  Production  process  complexity.  How  complex  is  the  process  for  developing 
the  product  or  service? 

4  Product  or  service  characteristics.  How  complex  is  the  product  or  service 
and  how  critical  are  the  interrelated  characteristics  of  the  product  to  its  per¬ 
formance? 
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♦  Product  or  service  safety.  How  costly  are  product  failures? 

♦  Economics.  How  costly  are  the  preceding  factors  relative  to  the  costs  of 
nonconforming  products? 


Table  2-1. 

ISO  9001  Quality  Elements  and  Cross-Reference 


Quality  system  element  (ISO  9004  description) 

Section  of  document 

ISO  9001 

ISO  9003 

Management  Responsibility 

4.1 

4.1 

4.1 

Quality  System  (quality  system  principles) 

4.2 

4.2 

4.2 

Contract  Review  (quality  in  marketing) 

4.3 

4.3 

— 

Design  Control  (quality  in  specification  and  design) 

4.4 

— 

— 

Document  Control  (quality  documentation  and  records) 

4.5 

4.4 

4.3 

Purchasing  (quality  in  procurement) 

4.6 

4.5 

— 

Purchaser-Supplied  Product 

4.7 

4.6 

— 

Product  Identification  and  Traceability  (material  control  and 
traceability) 

4.8 

m 

m 

Process  Control  (quality  in  production  and  control  of  pro¬ 
duction) 

4.9 

4.8 

— 

Inspection  and  Testing  (product  verification) 

4.1 

4.9 

4.5 

Inspection,  Measuring,  and  Test  Equipment  (control  of 
measuring  and  test  equipment) 

4.11 

4.1 

4.6 

Inspection  and  Test  Status  (control  of  verification  status) 

4.12 

4.11 

4.7 

Control  of  Nonconforming  Product  (nonconformity) 

4.13 

4.12 

4.8 

Corrective  Action 

4.14 

4.13 

— 

Handling,  Storage,  Packaging,  and  Delivery  (handling  and 
postproduction  functions) 

4.15 

4.14 

4.9 

Quality  Records 

4.16 

4.15 

4.1 

Internal  Quality  Audits  (auditing  the  quality  system) 

4.17 

4.16 

— 

Training  (personnel) 

4.18 

4.17 

4.11 

Servicing  (after-sales  servicing) 

4.19 

— 

— 

Statistical  Techniques  (use  of  statistical  methods) 

4.2 

4.18 

4.12 

Because  of  the  limited  nature  of  ISO  9003,  organizations  rarely  select  it  Few 
organizations  have  much  to  gain  by  merely  verifying  the  acceptability  of  their 
quality  processes  for  inspection  and  testing  operations.  Therefore,  the  real 
choice  for  most  organizations  wishing  to  adopt  an  ISO  quality  model  is  between 
ISO  9001  and  ISO  9002.  The  major  difference  between  those  two  standards  is  in 
the  treatment  of  the  design  control  (4.4)  and  servicing  (4.19) 
standards  —  ISO  9001  includes  product  design  and  servicing  and  ISO  9002  does 


2-6 


not.  In  deciding  which  standard  to  select,  the  organization  must  determine  the 
extent  to  which  the  design  of  the  product  or  service  affects  the  quality  and  per¬ 
formance  of  the  product  If  the  organization  has  complete  control  over  the  de¬ 
sign  of  the  product  and  that  control  is  a  major  factor  in  ensuring  product  quality, 
then  that  organization  should  choose  registration  under  ISO  9001;  otherwise, 
ISO  9002  would  be  the  correct  choice. 

In  the  engineering  industry,  "designs"  refer  to  end  products  and  the 
ISO  9001  "design  control"  standard  is  commonly  defined  as  "design  planning," 
which  requires  ensuring  the  product  (engineering  plans  or  designs)  is  delivered 
on  schedule,  within  budget,  and  meets  the  customer's  requirements.  Since  de¬ 
sign  planning  is  critical  to  the  quality  of  die  product,  so  far  all  engineering  firms 
have  chosen  to  adopt  the  ISO  9001  quality  assurance  model. 


The  Relationship  of  ISO  9000  and  Total  Quality  Management 

One  of  ISO's  greatest  strengths  is  its  versatility,  so  its  criteria  for  acceptabil¬ 
ity  fall  short  of  some  world-class  organizations'  quality  system  needs.  The  ISO 
standards  do  not  necessarily  define  an  exceptional  quality  management  system  or 
even  that  TQM  exists.  Actually,  the  quality  system  defined  by  ISO  9000  falls 
short  of  what  would  be  considered  a  bona  fide  TQM  system  and  only  begins  to 
approach  the  criteria  established  by  the  Malcolm  Baldridge  National  Quality 
Award  (MBNQA)  or  the  Presidential  Award  for  Quality.  Each  establishes  legiti¬ 
mate  quality  management  systems,  but  where  MBNQA  and  the  Presidential 
Award  strive  for  world-class  quality  systems  (Le.,  "the  best  of  the  best"),  the  ISO 
standards  only  demand  that  the  minimal  elements  of  total  quality  systems  exist 
ISO  9000  does  not  gauge  product  quality,  satisfied  customers,  and  continuous 
improvements  as  does  the  MBNQA,  for  example.  On  the  other  hand,  success¬ 
fully  implementing  TQM  would  be  difficult  without  first  meeting  the  quality 
system  elements  of  ISO  9000  since  ISO  standards  prescribe  the  fundamentals. 

Many  companies  are  choosing  to  use  the  ISO  9000  standards  as  a  way  to 
put  those  quality  system  fundamentals  in  place  and  then  to  implement  TQM  to 
further  improve  processes  and  perhaps  even  strive  for  the  world-class  quality 
embodied  in  MBNQA,  for  example.  Organizations  that  already  have  successful 
TQM  programs  however,  may  find  ISO  standards  redundant  For  them,  the 
ISO  9000  standards  can  be  considered  as  the  basic  components  of  a  much 
broader  quality  management  system.  Viewed  on  a  continuum,  the  relationship 
of  previous  quality  control  specification,  ISO  standards,  TQM,  and  today's  top- 
quality  awards  would  look  like  that  shown  in  Figure  2-4. 
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Options  for  Adopting  the  Standards 

Organizations  choosing  to  use  the  ISO  standards  for  improving  their  into' 
nal  quality  systems  or  as  quality  assurance  mechanisms  have  several  options  for 
adopting  them.  Most  companies  whose  customers  are  requiring  diem  to  regis¬ 
ter  are  entering  into  contractual  obligations  that  make  their  ISO  registrations 
mandatory.  Those  firms  have  no  choice  but  to  register  to  one  of  the  ISO  9000  se¬ 
ries  standards.  However,  some  companies  that  simply  want  to  improve  their  in¬ 
ternal  quality  management  systems  are  using  die  ISO  standards  as  a  model  or 
recipe  for  successfully  establishing  the  basic  elements  of  quality  management 
systems.  Those  companies  are  adopting  die  basic  premises  from  the  ISO  stan¬ 
dards  (typically  using  ISO  9004)  and  incorporating  them  into  their  operations 
and  procedures.  Because  they  are  voluntarily  adopting  the  standards,  they  can 
use  whatever  elements  they  feel  would  be  most  beneficial  to  their  companies 
and  ignore  die  ones  that  are  too  expensive  or  difficult  to  follow.  However,  since 
the  ISO  standards  prescribe  die  minimal  elements  of  quality  management, 
adopting  only  selective  elements  breaks  die  essential  balance  and  typically  what 
is  left  is  an  incomplete  quality  system  with  only  incremental  benefits. 

Companies  that  choose  to  self-regulate  to  die  ISO  standards  rather  than 
paying  for  die  external  verification  of  an  outside  auditor  may  perform  the  audits 
internally  as  though  an  outside  auditor  were  involved.  That  way,  they  are  able 
to  show  their  customers  that  they  have  fully  implemented  a  quality  system  that 
meets  the  ISO  requirements.  For  some  companies,  such  an  approach  may  be  all 
that  is  needed  to  realize  the  benefits.  Others,  however,  prefer  to  take  die  next 
step  and  voluntarily  become  registered.  They  have  found  that  any  approach  in¬ 
volving  self-regulation  requires  too  much  discipline  to  remain  committed  to 
their  objectives  and  that  die  registration  itself  provides  benefits  and  external  per¬ 
ceptions  of  their  quality  system  that  self-regulation  does  not 
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Registering  a  Quality  System 

Those  organizations  that  have  chosen  to  register  voluntarily  or  have  been 
contractually  required  to  register  have  found  that  the  ISO  9000  standards  are 
nothing  more  than  generic  guidelines  for  what  constitutes  an  acceptable  quality 
system.  Registration  to  the  ISO  9000  quality  system  standards  means  that  an  or* 
ganization  has  met  those  minimal  requirements  and  that  an  outside,  independ¬ 
ent  auditor,  known  as  an  ISO  quality  system  registrar,  has  examined  the 
organization's  quality  system  and  found  that  it  complies  with  its  interpretation 
of  the  ISO  standards.  The  audit  seeks  to  ensure  that  a  quality  system  exists,  that 
all  elements  of  the  ISO  standards  have  been  adequately  addressed,  that  the  ele¬ 
ments  are  sufficiently  documented,  that  processes  are  consistently  implemented 
in  accordance  with  that  documentation,  and  that  adequate  records  are  kepi  The 
auditors  (sometimes  called  assessors),  evaluate  the  organization's  quality  sys¬ 
tem,  and  if  it  meets  all  elements  satisfactorily,  the  company  is  granted  a  registra¬ 
tion  to  the  ISO  standard  selected  (ISO  9001,  9002,  or  9003).  In  some  cases, 
auditors  will  grant  conditional  registrations  pending  future  correction  of  defi¬ 
ciencies.  Usually,  the  next  reassessment  audit  will  be  used  to  verify  the  correc¬ 
tions.  Registration  does  not,  however,  guarantee  die  quality  of  the  product;  it 
simply  means  that  high-quality  processes  that  deliver  that  product  are  in  place. 


A  successful  organization  receives  a  certificate,  die  registration  is  published 
in  a  register  available  to  the  public,  and  the  organization  is  permitted  to  use  its 
registrar's  logo  in  its  marketing  and  to  display  it  in  its  advertising,  stationery, 
and  packaging  as  evidence  that  its  quality  system  meets  the  requirements  of  the 
ISO  standards.  Registrars  are  accredited  in  die  United  States  through  a  national 
central  authority  that  sanctions  each  registrar's  ability  to  bestow  registrations. 
Many  U.S.  registrars  have  entered  into  agreements  with  European  counterparts 
so  that  registrations  in  this  country  are  also  valid  in  die  worldwide  community. 


Registration  to  ISO  is  site-specific,  so  organizations  with  many  sites  must 
register  each  site  separately.  Once  a  site  becomes  registered,  that  registration  is 
valid  indefinitely  as  long  as  it  continues  to  pass  periodic  surveillance  audits.  Or¬ 
ganizations  that  fail  any  reassessment  may  lose  their  registration  and  die  privi¬ 
leges  that  go  with  it  Those  organizations  may  correct  those  deficiencies  and 
reapply  for  registration. 


History  and  Growth  of  the  ISO  Standards 

In  1987,  the  ISO  9000  standards  were  written  by  a  worldwide  delegation  to 
pull  together  and  standardize  all  the  different  qualify  system  standards  found  in 
different  countries  around  the  world.  Tracing  the  origins  of  every  separate  stan¬ 
dard  would  be  difficult;  however,  we  can  safely  say  that  the  ISO  standards  have 
a  basis  in  the  U.S.  DoD  MIL-Q-9858  military  quality  management  program  es¬ 
tablished  in  1959.  Later,  in  1968,  NATO  adopted  the  basic  elements  of  die 
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MIL-Q  standards  in  their  AQAP  series  of  quality  standards.  A  decade  later,  the 
British  developed  the  first  commercial  quality  assurance  standards,  the  British 
Standard  5750,  from  the  NATO  standards.  A  technical  committee  of  the  Interna¬ 
tional  Organization  for  Standards,  a  multinational  body  represented  in  the 
United  States  by  ANSI,  used  the  British  standards  as  the  basis  for  the  ISO  9000 
standards. 

The  multinational  body  agreed  at  the  time  die  ISO  standards  were  being  de¬ 
veloped,  that  they  would  be  updated  every  5  years.  Although  die  first  full  revi¬ 
sion  is  not  expected  until  19%,  the  technical  committee  has  already  developed  a 
plan  for  the  future  use  of  the  ISO  standards  through  the  year  2000. 

The  explosive  growth  of  ISO  9000  registration  in  this  country  can  be  traced 
to  die  regulatory  requirements  for  quality  system  registration  imposed  by  die 
EEC  Since  Europe  is  one  of  this  country's  largest  export  markets,  it  is  easy  to 
understand  why  many  U.S.  industries  are  so  rapidly  registering  to  die  ISO  9000 
standards.  Quite  simply,  for  certain  industries,  if  a  company  wants  to  do  busi¬ 
ness  in  the  European  market,  ISO  9000  registration  is  mandatory.  While  con¬ 
tractually  mandatory  registrations  may  have  been  the  catalyst  to  adopting  ISO 
in  the  United  States,  today,  growth  has  exceeded  that  primary  reason.  Those 
U.S.  firms  that  have  already  become  certified  are  finding  that  ISO  registration  is 
a  good  way  to  ensure  that  their  suppliers  have  suitable  quality  systems  in  place; 
as  a  result,  they  are  requiring  their  suppliers  to  become  registered  as  well,  which 
explains  the  rapid  growth  in  U.S.  registered  firms  over  die  past  5  years.  To  date, 
more  than  2,200  firms  are  registered  to  ISO  9000  standards,  which  is  about  four 
times  as  many  as  a  year  ago.  Figure  2-5  shows  the  growth  of  ISO  registration  in 
all  industries  in  the  United  States  by  quarter  since  die  beginning  of  1992. 
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Figure  2-5. 

Growth  of  ISO  Registration  in  the  United  States 
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To  date,  only  a  handful  of  firms  in  the  design  and  construction  industry 
have  become  registered  to  the  ISO  9000  standards.  For  those  firms,  the  force  im¬ 
pelling  that  registration  has  been  die  demand  from  the  international  market¬ 
place.  Despite  die  relatively  few  design  and  construction  firms  currently  regis¬ 
tered  to  ISO  9000,  interest  in  die  standards  is  growing  rapidly.  More  and  more 
firms  have  to  respond  to  requests  for  proposals  (RFPs)  that  include  statements 
addressing  ISO  compliance.  For  example,  one  registered  U.S.  firm  recently  re¬ 
sponded  (before  it  was  registered)  to  an  RFP  that  called  for  ". . .  a  quality  system 
in  place  like  ISO  9000."  While  ISO  registration  is  not  yet  required  by  building 
owners,  the  message  is  becoming  quite  clear  many  customers  will  soon  be  do¬ 
ing  business  only  with  design  and  construction  firms  that  deliver  quality  prod¬ 
ucts,  and  ISO  9000  will  be  used  to  verify  that  quality  management  practices  are 
being  followed.  In  recognition  of  that  trend,  many  firms  in  die  industry  are 
rushing  to  learn  more  about  ISO,  and  when  they  learn  of  die  many  benefits  of 
adopting  die  ISO  philosophy,  they  seek  registration.  An  informal  survey  of 
about  100  engineering  and  construction  firms  showed  that  only  one  was  ISO- 
registered,  but  almost  50  others  were  actively  pursuing  registration  and  all  oth¬ 
ers  were  in  the  process  of  learning  more  about  ISO. 


Reasons  to  Register 

In  addition  to  die  demands  of  the  EEC,  organizations  are  choosing  to  regis¬ 
ter  for  other  reasons.  Most  organizations  that  are  registering  to  any  one  of  the 
ISO  standards  are  doing  so  for  three  major  reasons:  customer  demands,  im¬ 
proved  quality  systems,  and  competitive  advantage.  Figure  2-6  illustrates  the 
six  top  reasons  from  Deloitte  &  Touche  and  the  Quality  Systems  Update  Newsletter 
industry  survey. 
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Figure  2-6. 

Primary  Reasons  to  Register 
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The  three  principal  reasons  for  U.S.  company  registration  are  as  follows: 

♦  Customer  demands .  For  the  most  part;  U.S.  companies  are  registering  be¬ 
cause  their  customers  demand  it  While  9.0  percent  of  the  respondents  said 
they  registered  because  they  were  doing  business  in  the  EEC,  more  than 
27  percent  of  the  respondents  say  that  their  primary  reason  for  registering 
was  that  customers  (other  than  those  in  the  EEC)  said  they  must  Many  of 
the  customers  that  made  those  demands  are  companies  that  already  regis¬ 
tered  themselves  and  have  begun  basing  the  selection  of  their  suppliers  and 
contractors  on  ISO  quality  system  compliance.  Almost  80  percent  of  the 
registered  firms  require  or  will  require  their  subcontractors  to  register. 

♦  Quality  system  improvement.  According  to  the  survey,  nearly  22  percent  of 
the  registered  companies  had  no  external  pressures  to  register  but  decided 
to  seek  ISO  registration  because  they  wanted  to  establish  stronger  quality 
foundations  within  their  organizations.  Their  goals  are  to  improve  produc¬ 
tivity  and  costs  and/or  to  enhance  customer  service  and  customer  satisfac¬ 
tion.  For  many,  TQM  programs  have  failed  because  of  fundamental  flaws 
in  their  implementation.  By  using  the  ISO  9000  quality  system  standards  as 
their  model,  they  are  putting  the  fundamental  quality  system  ingredients  in 
place  and  establishing  a  solid  foundation.  From  there,  some  hope  to  build 
even  stronger  quality  programs  using  TQM,  MBNQA,  and/or  other  quality 
system  criteria. 

♦  Competitive  advantage/necessity.  Almost  16  percent  of  the  registered  compa¬ 
nies  in  this  country  became  registered  because  they  want  to  use  their  ISO 
registrations  much  the  same  as  those  who  seek  the  MBNQA.  They  want  to 
become  some  of  the  first  in  their  respective  industries  to  become  registered 
and  then  they  want  to  use  those  registrations  in  their  marketing  and  adver¬ 
tising  strategies.  They  recognize  the  importance  of  demonstrating  to  their 
customers  that  they  are  aggressively  solving  quality  shortfall  problems. 
Their  goal  is  to  obtain  higher  sales  because  of  their  established  quality  posi¬ 
tions.  Similarly,  others  are  finding  that  the  rest  of  their  industry  is  register¬ 
ing  and  they  too  must  be  registered  so  that  they  will  not  be  closed  out  of 
their  respective  markets.  Nearly  all  registered  firms  from  the  survey  indi¬ 
cate  that  they  will  use  their  registrations  in  their  marketing  and  public  rela¬ 
tion  strategies. 

Informally,  we  found  that  the  reasons  engineering  and  construction  firms  in 
this  country  that  are  now  registered  or  are  seeking  registration  adopted  the  ISO 
standards  varied  as  widely  as  the  U.S.  marketplace  as  a  whole.  Quality  system 
improvements,  customer  requirements,  corporate  mandates,  and  competitive 
strategies  were  the  primary  reasons  they  registered.  Registered  firms  found  that 
a  growing  number  of  their  clients  are  "encouraging"  ISO  registration  as  proof 
titat  legitimate  quality  systems  exist  and  that  die  company  will  be  capable  of  de¬ 
livering  die  quality  product  and  service  as  promised.  However,  traced  back  to 
their  underlying  causes,  the  requirements  of  the  international  marketplace 
seemed  to  initiate  their  motives  of  pursuing  registration. 
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Typical  Cost  of  Registration 


The  cost  to  adopt  the  ISO  9000  standards  and/or  become  registered  is 
strongly  dependent  on  the  quality  systems  that  the  organization  currently  has  in 
place  and  can  vary  greatly  from  one  organization  to  the  next  For  example,  an 
organization  drat  already  has  good  documentation  of  its  processes  and  proce¬ 
dures  will  invest  much  less  effort  into  complying  with  the  ISO  requirements 
than  an  organization  that  has  no  such  documentation.  Most  companies  will 
need  6  months  to  a  year  to  prepare  for  die  initial  registration  audit  In  addition 
to  die  up-front  implementation  cost  organizations  that  decide  to  register  will  ex¬ 
perience  yearly  on-going  costs  to  maintain  ISO  compliance. 

Costs  to  adopt  the  ISO  9000  requirements  fall  into  six  categories.  For  most 
companies,  die  largest  cost  will  probably  be  for  interpreting  die  ISO  standards 
and  creating  those  procedures  necessary  to  comply  with  die  ISO  requirements. 
The  second  largest  cost  will  probably  be  for  developing  die  required  documenta¬ 
tion,  including  die  quality  manual,  operating  procedures,  and  work  instructions 
if  necessary.  The  third  cost  category  is  for  training;  organizations  will  want  to 
provide  2  to  4  hours  of  basic  ISO  training  to  everyone  in  die  organization  and 
perhaps  40  to  80  hours  of  training  for  several  persons  who  will  be  responsible 
for  internal  audits  of  the  quality  system.  The  bask  training,  while  not  actually 
required  by  die  ISO,  is  a  very  good  idea,  since  it  will  help  educate  personnel 
who  will  be  responsible  for  the  program's  success  and  will  help  alleviate  fears 
that  ISO  standards  will  dramatically  change  peoples'  jobs.  The  fourth  cost  cate¬ 
gory,  and  perhaps  the  smallest  includes  the  time  that  die  organization's  leader¬ 
ship  will  need  to  manage  die  program's  implementation  efforts,  hold  meetings 
with  the  registrar  and  staff,  and  perform  internal  audits.  The  fifth  cost  category 
consists  of  external  expenses  for  consultants  and  perhaps  preliminary  audits. 
Not  all  organizations  choose  to  use  consultants,  and  many  perform  all  of  their 
preliminary  audits  in  house.  The  final  category  of  costs  includes  those  costs  for 
the  actual  registration,  which  typically  entails  a  flat  fee  paid  to  an  external  regis¬ 
trar.  The  Deloitte  &  Touch e/ Quality  Systems  Update  Newsletter  survey  shows 
that  medium-to-large  companies  ($50  million  to  $500  million  annual  revenues) 
spend  an  average  of  $150,000  to  $350,000  on  those  internal  and  external  compli¬ 
ance  costs. 

According  to  the  survey,  all  companies  drat  choose  to  register  will  spend 
another  $20,000  to  $40,000  on  the  registration  itself.  The  actual  costs  of  the  regis¬ 
tration  will  depend  largely  on  what  die  scope  of  registration  is  and  how  many 
audits  are  required  before  the  organization  meets  die  registrar's  requirements. 
Therefore,  the  total  costs  of  implementing  and  registering  under  ISO  9000  will 
range  between  $170,000  and  $390,000.  Most  companies  can  expect  to  pay 
around  10  percent  of  die  total  implementation  cost  for  actual  registration.  While 
that  cost  seems  high,  nearly  all  companies  that  have  registered  under  die  ISO 
standards,  regardless  of  whether  they  were  externally  or  internally  motivated  to 
do  so,  say  that  it  is  worth  the  time,  effort,  and  cost  Nearly  all  die  organizations 
surveyed  experienced  quantifiable  yearly  savings  as  a  direct  result  of  die  regis¬ 
tration.  Those  and  other  benefits  will  be  discussed  in  the  following  section. 
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The  ISO-related  costs  do  not  end  once  an  organization  registers.  Since  the 
ISO  9000  is  not  an  award  or  a  recognition  program,  the  organization  must  con¬ 
tinually  prove  itself  to  registrars.  Depending  on  the  initial  audit,  an  annual  or 
biannual  reassessment  of  the  organization's  quality  system  will  be  necessary. 
Reassessment  audits  will  cost  between  $3,000  and  $6,000.  Also,  the  ISO  stan¬ 
dards  themselves  require  some  on-going  costs  for  full-time  management  of  the 
program  and  periodic  internal  audits  of  the  organization's  quality  system.  The 
engineering  companies  we  interviewed  suggested  that  a  full-time  person  re¬ 
sponsible  for  quality  programs  (in  which  ISO  is  a  part)  plus  half  of  a  full-time 
equivalent  staff  member  for  conducting  the  ISO-required  internal  audits  are 
needed  to  meet  the  ISO  standards. 


Benefits  of  Registration 


Most  companies  adopt  or  become  registered  to  the  ISO  standards  because 
they  expect  tangible  benefits  that  can  be  categorized  as  internal  or  external.  Fig¬ 
ure  2-7  shows  the  most  important  internal  benefits:  better  documentation, 
greater  awareness  of  quality  management,  and  positive  cultural  change  topped 
the  survey  and  accounted  for  73  percent  of  the  industry  responses.  While  not 
nearly  as  significant  as  the  others,  nearly  10  percent  of  die  respondents  said  in¬ 
creased  operational  efficiency  and  productivity  were  die  greatest  benefits  of  ISO 
registration.  The  most  significant  external  benefits  of  ISO  registration,  shown  in 
Figure  2-8,  were  a  higher  perceived  quality,  improved  customer  satisfaction,  and 
increased  competitive  advantage.  Nearly  82  percent  of  the  respondents  picked 
one  of  those  top  three  external  benefits.  While  still  a  quantifiable  benefit,  only 
8.5  percent  of  die  respondents  said  reducing  customer  quality  audits  was  their 
biggest  reason  for  becoming  registered  to  the  ISO  quality  assurance  standards. 


Figure  2-7. 

Most  Important  Internal  Benefits 
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Perception  33.5% 


Figure  2-8. 

Most  Important  External  Benefits 


Nearly  all  registered  companies  —  even  those  that  were  forced  to 
register  —  said  they  experienced  definite  quantifiable  benefits  from  adopting  the 
standards.  Payback  for  about  half  die  companies  came  in  about  3  years,  but 
30  percent  were  paid  back  in  12  months  or  less.  Our  interviews  in  the  engineer¬ 
ing  industry  suggest  that  previous  inefficiencies,  lost  design  effort,  and  lack  of 
commitment  to  quality  meant  diat  improvement  resulting  from  ISO  would  re¬ 
sult  in  investment  payback  in  less  than  1  year.  So  far,  the  engineering  staffs  in 
those  organizations  are  highly  receptive  to  the  changes  fruit  ISO  9000  encour¬ 
ages. 


Implementation  Barriers 

According  to  the  survey  of  registered  firms  (see  Figure  2-9),  the  most  diffi¬ 
cult  aspect  of  meeting  the  ISO  requirements  is  developing  the  necessary  ISO- 
compliant  procedures  and  documenting  those  procedures.  Nearly  40  percent 
said  that  those  were  the  greatest  barriers  to  ISO  registration.  The  next  most  cited 
barrier  to  successful  implementation  was  inadequate  management  commitment 
Overall,  nearly  10  percent  of  the  respondents  had  leadership  difficulties,  but 
management  commitment  was  a  greater  problem  for  large  companies  than  for 
small  ones.  Surprisingly,  a  relatively  small  percentage  (about  12  percent)  of  the 
firms  already  registered  to  the  ISO  standards  say  that  employee  resistance  and 
employee  training  were  serious  barriers  to  implementing  the  ISO  standards. 
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In  the  design  and  construction  firms  we  interviewed,  developing  the  ISO 
procedures  and  the  required  registration  and  getting  and  keeping  managemen¬ 
t's  commitment  to  the  program  were  universally  the  greatest  difficulties  in  be¬ 
coming  registered. 


Document  development  18. 


Procedure  development  19.7% 


Inadequate  commitment  9.5% 

Following  proceduree  8.1*  _  _ 

All  other  barriers  24.3% 

Employee  reeietance  7.9% 

Conflicting  interpretation  7.4%  Training  requirement  4.4% 


Figure  2-9. 

Barriers  to  ISO  Registration 


USACE  Customers 

As  discussed  earlier,  customer  demand  is  a  fundamental  reason  for  an  or¬ 
ganization  to  decide  to  register  to  ISO.  Sometimes,  it  makes  registration  manda¬ 
tory.  All  the  U.S.  firms  doing  business  in  the  EEC  have  experienced  that 
requirement,  and  to  avoid  the  risk  of  losing  their  European  business  bases,  they 
are  quickly  moving  to  register  under  one  of  the  ISO  quality  standards.  The 
same  phenomenon  is  true  in  doing  business  with  U.S.  companies;  firms  that  are 
already  registered  recognize  the  value  that  adopting  the  basic  tenets  of  ISO  stan¬ 
dards  brings  to  the  quality  of  their  products.  Therefore,  registered  U.S.  compa¬ 
nies  are  now  requiring  their  suppliers  in  the  United  States  to  become  registered 
too.  Such  requirements  are  reaching  down  several  tiers  into  the  customer- 
supplier  chains. 

So  far,  none  of  USACE's  current  customers  has  instituted  ISO-only  require¬ 
ments  in  its  source  selection  criteria  or  as  a  contractual  requirement  At  this 
time,  none  anticipate  doing  so  in  the  future.  If  USACE  anticipated  that  its  pri¬ 
mary  customers  would  begin  requiring  ISO  registration  for  all  their  suppliers, 
then  it  would  be  obvious  to  conclude  that  USACE  should  become  registered  as  a 
means  to  stay  in  business. 
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Notwithstanding,  some  evidence  indicates  that  the  Federal  government  is 
taking  some  actions  on  the  ISO  standards.  A  new  Federal  directive  published  in 
the  October  26, 1993  Federal  Register  directs  Federal  agencies  to  vise  international 
standards  such  as  the  ISO  9000  quality  assurance  standards  whenever  possible 
in  procurement  and  regulatory  activities.  The  result  may  be  that  companies  reg¬ 
istered  to  ISO  may  have  a  competitive  advantage  in  obtaining  future  govern¬ 
ment  contracts.  The  directive  states:  " International  standards  should  be  considered 
in  procurement  and  regulatory  applications  in  the  interests  of  promoting  trade  and  im¬ 
plementing  the  provisions  of  the  agreement  on  technical  barriers  to  trade  and  the  agree¬ 
ment  on  government  procurement." 

Several  government  agencies,  including  DoD,  the  Department  of  Energy, 
General  Services  Administration,  and  NASA  already  are  using  or  are  consider- 
ii.g  the  use  of  ISO  standards.  In  DoD,  a  multi-service  task  force  has  been  assem¬ 
bled  to  look  at  the  ISO  standards  and  determine  their  impact  on  military 
contracting.  The  draft  report,  which  is  due  in  April  of  1994,  is  expected  to  give 
contracting  officers  the  flexibility  to  include  ISO  9000  provisions  in  future  con¬ 
tracts.  For  the  time  being,  ISO  standards  are  likely  to  be  used  to  supplement, 
but  not  replace,  current  military  specifications  in  contractual  requirements.  If 
contracting  officers  are  allowed  to  do  so,  other  DoD  agencies  and  USACE  will  be 
able  to  include  the  ISO  standards  in  contractual  relationships  to  verify  that  qual¬ 
ity  systems  of  their  suppliers  meet  the  ISO  standards.  The  forthcoming  direc¬ 
tives  will  certainly  increase  the  spread  of  ISO  registration  to  even  more  U.S. 
firms. 
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Chapter  3 


Quality  Initiatives  in  the  USACE  Today 


USACE  Quality  Management  Initiatives 

The  quality  of  its  products  has  always  played  a  central  role  in  USACE's  ap¬ 
proach  to  its  engineering  and  design  services.  At  its  core,  the  integrity  of  dams, 
buildings,  bridges,  plants,  and  other  facilities  is  of  paramount  concern  in  protect¬ 
ing  the  public  safety.  Engineers  and  architects  must  ensure  that  each  design  not 
only  complies  with  appropriate  building  codes  and  industry  standards  but  also 
satisfies  the  customer's  technical  needs.  An  elaborate  set  of  criteria  is  managed 
by  USACE  to  ensure  that  its  designers  are  kept  up  to  date  and  follow  current  re¬ 
quirements  for  engineering  and  design  services.  The  USACE  criteria  system  is 
die  cornerstone  of  the  USACE  quality  management  system. 

A  number  of  improvements  to  die  USACE  quality-related  policies  and  pro¬ 
cedures  have  been  initiated  over  the  past  years  to  further  improve  technical 
product  quality  and  quality  control,  and  to  address  customer  satisfaction.  At  die 
forefront.  Total  Army  Quality  (TAQ)  is  USACE's  response  to  the  Army's  and 
DoD's  calls  for  TQM.  TAQ  will  be  discussed  in  the  following  sections.  The  fol¬ 
lowing  are  among  some  of  the  other  significant  quality  steps  USACE  has  under¬ 
taken: 

♦  The  Corps  established  the  A-E  Contract  Administration  and  Support  Sys¬ 
tem  (ACASS),  an  automated  system  for  recording  A-E  contractor  perform¬ 
ance  on  specific  contracts,  and  it  oversees  the  ACASS  for  DoD.  USACE 
districts  and  other  Defense  agencies  are  required  to  query  ACASS  before  se¬ 
lecting  A-E  firms  for  contracts  to  verify  that  the  past  performance  of  those 
firms  has  been  satisfactory.  In  the  future,  all  Federal  agencies  may  be  re¬ 
quired  to  use  ACASS. 

♦  The  National  Institute  of  Building  Sciences  began  publishing  in  its  Con¬ 
struction  Criteria  Base  (CCB)  guide  specifications  and  other  criteria  fur¬ 
nished  quarterly  by  USACE,  other  construction  agencies,  and  industry 
standards  groups.  The  quarterly  updates  using  compact  disk,  read-only 
memory  technology  ensure  that  the  latest  criteria  are  available  for  subscrib¬ 
ers,  including  all  Corps  districts  and  A-E  firms.  For  convenience,  many 
other  types  of  information,  such  as  design  manuals  and  military  handbooks 
are  included  in  the  CCB  to  assist  designers  in  preparing  plans  and  tailoring 
specifications  for  each  project  and  keeping  abreast  of  criteria  and  technology 
changes. 

♦  When  designers  encounter  technical  problems  that  may  have  Corps-wide 
interest  and  could  affect  current  criteria,  updates  to  the  criteria  are 
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published  in  the  CCB.  Thus,  USACE  has  an  effective  quality  control  proc¬ 
ess  to  report  such  problems,  ensure  they  are  channeled  to  the  appropriate 
technical  experts,  and  see  that  they  are  resolved  expeditiously.  Results  are 
published  in  the  Engineering  Improvement  Recommendation  System 
Bulletin  -  better  known  as  the  EIRS  Bulletin. 

♦  The  Automated  Review  Management  System  (ARMS)  has  recently  been  in¬ 
troduced  by  USACE  as  another  significant  quality  assurance  improvement 
to  help  clarify,  track,  and  record  design  comments  made  by  customers  and 
in-house  review  teams.  Designs  cannot  be  approved  for  construction  until 
all  review  comments  are  resolved  satisfactorily.  An  additional  ARMS  fea¬ 
ture  allows  design  managers  to  review  and  analyze  the  nature  of  comments 
and  detect  trends  with  certain  technical  areas,  A-E  firms,  or  customer  con¬ 
cerns.  ARMS  has  imposed  greater  discipline  on  the  design  review  process 
and  is  an  important  step  forward  for  USACE  quality  management  systems. 


USACE  Total  Quality  Initiatives 

In  genera],  USACE  customers  regard  the  technical  quality  of  its  engineering 
and  design  products  as  superior.  Their  expectations  are  changing  however,  and 
while  delivery  of  a  technically  superior  product  is  assumed,  those  products  are 
also  expected  to  be  delivered  on  schedule  and  within  a  reasonably  budgeted  dol¬ 
lar  amount.  Moreover,  Army  customers  are  beginning  to  examine  choices  for 
selecting  alternative  design  agents  when  their  expectations  of  Corps  quality  are 
not  being  met  We  encountered  at  least  two  customers  that  are  actively  consid¬ 
ering  alternatives  based  on  recent  unsatisfactory  experience  with  USACE  costs, 
responsiveness,  products,  and  level  of  service. 

A  reduction  in  military  workload,  the  reality  of  downsizing  and  the  threat 
of  closing  districts  and  divisions  have  caused  USACE  to  begin  examining  its 
quality  processes.  Efforts  to  streamline  its  A-E  contracting  process,  one  of  the 
more  notorious  stumbling  blocks  in  responding  to  customers,  have  resulted  in 
establishing  duration  standards  for  contractor  selection,  negotiation,  and  award. 
Headquarters,  USACE,  has  also  published  planning  and  design  cost  targets  that 
establish  rates  that  customers  should  expect  to  pay  for  design  services.  Those 
rates  vary  by  project  size  and  complexity  and  are  being  used  to  gauge  individual 
district  and  division  cost  performance.  A  comprehensive  review  of  the  man¬ 
power  model  used  to  establish  manpower  requirements  on  the  basis  of  projected 
workload  is  also  being  conducted.  Other  initiatives,  including  the  examination 
of  overhead  costs,  review  processes,  organization  and  staffing  requirements,  and 
customer  planning  deficiencies,  are  part  of  this  comprehensive  quality  review 
initiative.  In  summary,  some  important  and  far-reaching  steps  are  being  taken 
to  examine  key  elements  of  the  USACE  engineering  and  design  total  quality 
process. 

Engineering  Regulation  1110-1-12,  Engineering  and  Design  Quality  Manage¬ 
ment,  CEMP-ES/CECW-EP,  dated  I  June  1993,  is  another  important  milestone 
that  USACE  has  reached  in  its  quest  for  total  quality.  That  document  provides 
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general  policy  and  principles  for  improving  the  quality  of  engineering  and  de¬ 
sign  services  and  products,  and  serves  as  a  guideline  for  quality  procedures, 
practices,  and  tools.  Within  the  general  precepts  of  total  quality  management, 
and  in  line  with  the  philosophy  of  ISO  9000,  the  engineering  regulation  seeks  to 
focus  on  customer  requirements,  strive  for  continuous  process  improvement, 
and  empower  people  with  the  responsibility  and  accountability  to  achieve  excel¬ 
lence  within  their  full  potential.  Among  the  many  facets  of  engineering  and  de¬ 
sign  quality  identified  in  ER  1110-1-12,  a  few  of  die  more  significant  are  as 
follows: 

♦  Customer  requirements  must  be  thoroughly  understood  and  documented 
at  project  inception;  otherwise,  delays  and  false  starts  can  be  expected. 

♦  Coordination  among  all  engineering  and  design  participants  is  vital,  and 
the  responsibilities  of  the  customer,  project  manager,  technical  manager, 
and  designer  must  be  carefully  defined.  The  role  of  the  designer  during  the 
construction  phase  is  also  highlighted. 

♦  Project  management  plans  and  quality  control  plans  are  essential  tools  that 
define  how  quality  will  be  incorporated  into  each  USACE  project 

♦  The  process  of  quality  verification  through  a  system  of  reviews,  checklists, 
and  record  keeping  (ARMS)  is  necessary  for  proper  quality  discipline. 

♦  Accurate  and  timely  designer  evaluations  are  important  to  ensure  that  fu¬ 
ture  designer  selections  consider  past  performance. 

♦  A  lessons-leamed  feedback  system  that  collects  information,  is  integrated 
with  design  criteria  management,  and  is  readily  available  to  all  designers  is 
to  be  implemented  by  each  USACE  command. 

♦  Effective  partnering  arrangements  are  needed  among  professionals  as  well 
as  among  all  participants  in  the  engineering  and  design  process. 

This  engineering  and  design  quality-management  regulation  provides  a 
needed  compendium  of  many  quality-management  requirements  that  previ¬ 
ously  have  been  promulgated  in  a  piecemeal  fashion.  The  document  should  not, 
however,  be  viewed  as  comprehensive  guidance  for  total  quality  engineering 
and  design  management  While  it  acknowledges  in  its  policy  section  that  re¬ 
sponsiveness  and  cost  are  important  ingredients  of  the  total  quality  process,  it 
fails  to  deal  with  the  specifics  of  those  total  quality  dimensions  in  serious  detail. 
The  primary  focus  of  ER  1110-1-12  rests  in  the  more  traditional  USACE  ap¬ 
proach  to  quality  through  the  technical  dimension  only. 


Total  Army  Quality 

Army  Regulation  5-1,  Army  Management  Philosophy,  dated  12  June  1992,  es¬ 
tablished  TAQ  as  the  Army's  management  philosophy.  It  provides  the 
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methodology,  tools,  and  techniques  to  perform  die  systematic  analyses  of  or¬ 
ganizations,  businesses,  and  work  processes  to  achieve  die  requisite  improve¬ 
ments.  The  method  for  implementing  TAQ  is  described  in  the  Army  guidance 
Leadership  for  Total  Army  Quality  Concept  Plan;  die  plan  was  initially  developed  in 
February  1993  and  is  now  being  refined.  The  plan  is  based  upon  the  vision 
statement  shown  in  Figure  3-1. 


Vision  Statement 

America’s  Army  is  a  partner  in  freedom  which  the 
Nation  can  count  on....  A  total  force  trained  and 

ready  to  fight. . .  serving  our  Nation  at  home  and 
abroad. ...  A  strategic  force  capable  of  decisive  vic¬ 
tory. 


Source;  AR5-1. 

Figure  3-1. 

Army  Vision  Statement 


The  plan  is  structured  to  provide  sufficient  detail  for  consistency  in  the 
Army's  overall  approach  while  giving  commanders  maximum  flexibility  in  de¬ 
veloping  an  implementation  plan  for  their  organizations.  It  has  been  organized 
into  four  phases  —  awareness,  assessment,  team  building,  and  action.  Patterned 
along  die  lines  of  other  TQM  concepts,  TAQ  recommends  establishing  top  and 
middle  management  policy  and  advisory  committees  with  workers  organized 
into  process  action  teams  to  tackle  specific  process  improvement  initiatives. 

The  customer  must  remain  at  center  stage  in  any  quality  management  en¬ 
deavor,  and  the  Army  has  defined  the  nation  as  its  ultimate  external  customer 
and  the  soldier  as  the  ultimate  internal  customer.  The  mission  assigned  to 
USACE  to  support  both  Civil  Works  Programs  and  Military  Programs  can  eas¬ 
ily  relate  to  and  identify  both  die  nation  and  die  soldier  as  customers  of  its  di¬ 
verse  services.  In  his  memorandum  of  22  April  1993  (see  Appendix  A),  LTG 
Williams,  Commander,  USACE,  announced  his  full  support  for  TAQ  and  en¬ 
couraged  all  USACE  commanders  to  adopt  the  concept  and  determine  how  best 
to  implement  it  within  their  respective  organizations. 

Most  USACE  organizations  have  made  some  effort  to  adopt  TAQ,  albeit  to 
varying  degrees.  Some  Corps  commands  had  recognized  the  benefits  of  TQM 
before  the  Army  formally  established  TAQ  and  were  making  independent  head¬ 
way  toward  continuous  process  improvement  One  district  had  embarked  upon 
an  extensive  employee  training  program  and  was  anticipating  improvements  in 
its  many  processes.  Several  districts  have  assigned  key  senior  managers  to 
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oversee  TAQ  implementation  on  a  full-time  basis,  and  executive  steering  com¬ 
mittees  have  been  activated.  We  found  that  process  action  teams  have  also  been 
formed  and  a  number  of  improvements  have  already  been  identified  and  imple¬ 
mented.  Our  limited  sample  of  visits  with  three  districts  and  discussion  with 
two  others  indicate  that  TAQ  is  being  well  received  within  those  USACE  organi¬ 
zations  adopting  it  During  those  visits  we  also  found  that  some  efforts  lacked 
continuity  and  that  success  may  be  limited  because  of  die  absence  of  an  overall 
framework  and  criteria  for  measuring  success. 

In  February  1994,  Headquarters,  USACE,  established  a  Quality  Council,  pri¬ 
marily  to  oversee  quality  initiatives  in  die  Headquarters  organization.  The 
Council's  functions  are  expected  to  be  expanded  to  provide  guidance  and  sup¬ 
port  to  all  USACE  TAQ  and  other  quality  initiatives. 


Compliance  with  Quality  System  Standards 

To  assess  how  difficult  the  task  might  be  if  USACE  were  to  adopt  and  com¬ 
ply  with  the  ISO  9000  quality  system  standards,  we  first  translated  each  of  die 
ISO  9001  standards  into  terms  applicable  to  USACE  field  organizations.  We 
then  developed  a  set  of  guidelines  for  use  in  checking  conformity  to  each  of 
ISO  9001's  20  quality  system  elements.  Appendix  C  summarizes  those  stan¬ 
dards  and  guidelines.  Additional  work  is  expected  to  be  necessary  to  refine 
those  guidelines  for  general  use  and  for  tailoring  to  each  field  organization,  con¬ 
sistent  with  the  opinions  of  auditors  and  registrars. 

The  standards  and  guidelines  in  Appendix  C  appear  quite  extensive,  but  we 
believe  the  USACE  districts  we  visited  are  fundamentally  sound  with  basic  qual¬ 
ity  management  elements  in  place  (although  some  improvements  in  this  area  are 
warranted).  Imposing  the  requisites  of  quality  processes  embedded  in  the 
ISO  9000  standards  on  districts  is  clearly  a  management  challenge  rather  than  a 
technical  one.  Nevertheless,  considerable  work  will  be  needed  to  comply  with 
ISO  9000.  For  example,  the  standards  require  significant  documentation  of  engi¬ 
neering  and  design  processes.  Document  control,  records  management,  train¬ 
ing,  and  customer  requirements  will  need  serious  attention,  and  a  major  effort 
(and  cost)  will  be  necessary  to  develop  and  implement  a  structured  implementa¬ 
tion  program.  Finally,  the  entire  quality  management  concept  under  ISO  9000 
standards  must  be  orchestrated  in  a  comprehensive  and  coordinated  framework 
of  planning  with  training  and  documentation  as  its  pivotal  thrusts. 

To  be  able  to  "say  what  we  do"  (a  first  step  toward  ISO  9000  registration)  re¬ 
quires  die  preparation  of  extensive  documentation  describing  each  major  engi¬ 
neering  process  affecting  product  quality.  Auditors  must  be  able  to  understand 
the  processes  to  verify  that  "we  do  what  we  say"  (the  second  step  of  ISO  9000 
standards  compliance).  Most  USACE  processes  are  broadly  described  in  direc¬ 
tives  and  regulations,  but  local  process  documentation  is  inadequate.  Based  on 
experiences  of  private-sector  companies,  having  processes  accurately  docu¬ 
mented  not  only  improves  productivity,  it  also  reduces  uncertainty  and,  thus, 
enhances  employee  morale.  Developing  proper  documentation  will  be  a  major 
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effort,  but  for  those  districts  that  decide  to  pursue  compliance  with  ISO  9000 
standards,  their  experience  in  preparing  die  documentation  will  reduce  the  ef¬ 
fort  for  others  that  follow. 

The  USACE  field  activities  generally  believe  that  their  quality  management 
systems  are  adequate;  however,  we  found  that  their  control  of  some  of  the  proc¬ 
esses  and  procedures  that  produce  their  engineering  and  design  products  are 
not  compliant  with  an  ISO  quality  management  system  and,  in  most  cases, 
needs  improvement  Their  current  quality  systems  are  oriented  more  toward 
product  —  not  process  —  quality.  The  issues  of  cost  containment  and  schedule, 
for  example,  have  been  less  important  than  the  technical  capability  of  the  fin¬ 
ished  products. 

We  found  that  too  many  process  activities  are  individual-dependent  and 
when  key  persons  are  absent  processes  often  come  to  a  halt  rattier  than  operate 
effectively  under  prepared  schedules  or  with  trained  backups.  Record  keeping 
in  some  areas,  such  as  contract  files  is  very  detailed,  but  in  other  areas  including 
master  lists  of  current  guidance  and  criteria  and  consistent  utilization  of  ARMS, 
is  inadequate.  Controls  over  customer  requirements  and  monitoring  those  re¬ 
quirements  through  processes  to  final  product  delivery  are  also  important  vul¬ 
nerabilities  that  need  to  be  addressed.  Project  management  plans  required  by 
ER  5-7-1,  Project  Management,  offer  a  format  for  strengthening  controls  over  qual¬ 
ity  management  processes  and  systems  and  need  to  be  updated  continuously 
through  process  delivery. 

Pursuing  improvements  under  each  of  these  critical  ISO  9000  standards  will 
require  much  work;  however,  unless  those  improvement  efforts  are  established 
within  the  comprehensive  and  coordinated  framework  of  a  quality  management 
system,  the  Corps  will  not  be  able  to  comply  with  the  standards.  Establishing 
process  action  teams  and  quality  management  boards  is  to  be  applauded,  but 
the  efforts  of  such  groups  must  be  cohesive  and  focused.  Structured  and  selec¬ 
tive  training  programs  tied  to  objectives  clearly  set  forth  in  a  quality  manage¬ 
ment  plan  will  ensure  that  such  training  is  effective.  A  number  of  districts  have 
prepared  strategic  plans  for  quality  enhancement,  but  they  fall  short  of  specify¬ 
ing  the  level  of  detail  or  comprehensiveness  required  for  quality  systems  that 
would  lead  to  ISO  9000  registration. 

Fortunately,  USACE  field  offices  appear  to  have  a  strong  interest  in  quality 
improvement  through  use  of  quality  systems.  Some  district  commanders  and 
their  management  teams  have  already  demonstrated  their  commitment  to  im¬ 
prove  quality,  and  we  sense  that  application  of  the  ISO  9000  standards  may  pre¬ 
sent  an  opportunity  for  districts  to  better  channel  those  improvement  initiatives. 
Adopting  the  ISO  9000  standards  could  certainly  provide  an  effective  foundation 
for  all  USACE  quality  initiatives,  including  TAQ. 
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Chapter  4 

Conclusions  and  Recommendations 


The  USACE  is  the  world's  largest  engineering  and  design  organization  and 
is  responsible  for  executing  around  $700  million  worth  of  engineering  and  de¬ 
sign  work  every  year.  Its  product  has  long  been  a  symbol  of  engineering  exper¬ 
tise.  Today,  USACE's  customers  are  asking  for  more.  While  they  still  want  and 
need  USACE's  functional  expertise,  they  are  now  demanding  total  quality  in 
USACE  products  and  services.  The  issues  of  quality  engineering  product  and 
the  costs  of  delivering  that  product  are  becoming  increasingly  important  as  mili¬ 
tary  construction  budgets  decrease  and  business  with  customers  outside  DoD 
becomes  necessary  to  sustain  the  current  USACE  business  base.  To  continue  as 
the  world's  foremost  engineering  and  design  organization,  USACE  must  deliver 
die  products  its  customers  want;  on  schedule,  within  budget,  and  with  excellent 
service.  For  USACE  to  meet  its  customers'  demands  for  total  quality,  it  must 
change  the  way  it  delivers  engineering  and  design  products  —  it  needs  to  insti¬ 
tute  quality  into  the  very  framework  of  the  organization  and  processes  that  de¬ 
liver  its  products. 

Recognizing  the  importance  of  costs,  schedules,  and  quality  products, 
USACE  has  recently  undertaken  a  number  of  separate  initiatives  to  improve  the 
quality  of  the  processes  it  uses  to  deliver  those  products.  While  those  initiatives 
are  a  step  in  die  right  direction,  they  do  not  go  far  enough.  What  is  needed  is  a 
structured  approach  or  "blueprint"  for  integrating  all  the  separate  quality  initia¬ 
tives  USACE  is  now  undertaking  in  order  to  keep  its  efforts  and  the  resources 
devoted  to  those  efforts  focused.  USACE  needs  to  establish  a  solid  quality  sys¬ 
tem  foundation  first,  including  sound  quality  management  practices  backed  by 
quality  documentation,  before  the  maximum  benefits  of  the  other  programs  can 
be  realized. 

The  ISO  9000  series  standards  provide  a  ready  recipe  for  establishing  a  fun¬ 
damental  quality  management  system  framework  that  will  deliver  numerous 
benefits.  Adopting  the  ISO  90001  quality  assurance  standards  offers  USACE  a 
systematic  approach  to  implementing  bona  fide  quality  management  practices 
by  forcing  it  to  comply  with  the  20  elements  of  the  ISO  9001  quality  assurance 
standard.  By  adopting  the  standards,  USACE  will  be  emplacing  an  excellent 
quality  system  foundation  that  is  internationally  recognized  in  both  the  private 
and  public  sectors.  Appendix  C  shows  how  the  ISO  9001  standards  can  be 
adapted  to  USACE  operations  and  offers  some  guidelines  that  show  what 
USACE  field  activities  will  need  to  do  to  comply  with  the  standards.  This  chap¬ 
ter  provides  our  conclusions  about  using  those  ISO  quality  standards  and  pre- 
sents  our  recommendations  for  how  USACE  should  adopt  them. _ 

‘ISO  9001  is  recommended  because  of  the  impact  that  design  planning  has  on  the 
eventual  quality  of  the  finished  product  in  terms  of  its  ability  to  meet  the  customer's  re¬ 
quirements,  on  time,  and  within  budget. 
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Conclusions 


Because  they  work,  the  ISO  9000  quality  standards  are  rapidly  becoming  die 
world's  preferred  and  established  criteria  for  gauging  the  acceptability  of  an  or¬ 
ganization's  quality  system.  Thousands  of  organizations  in  Europe,  Asia,  and 
the  Americas  are  adopting  quality  management  practices  consistent  with  the 
ISO  standards  to  improve  productivity,  customer  service  and  satisfaction,  and 
foe  organization's  competitive  posture.  While  they  are  not  the  ultimate  world- 
class  quality  systems  embodied  by  the  MBNQA  or  die  Presidential  Award  for 
Quality,  the  ISO  standards  offer  a  significant  first  step  toward  achieving  higher 
quality  systems  of  the  future.  Thus,  every  indication  is  that  customers  will  con¬ 
tinue  to  use  the  ISO-based  standards  in  the  United  States  as  the  primary  method 
for  evaluating  the  adequacy  of  a  supplier's  quality  system  and  a  growing  num¬ 
ber  of  organizations  will  use  diem  as  models  for  improving  or  implementing  in¬ 
ternal  quality  systems.  The  ISO  standards  are  here  to  stay. 

One  of  the  greatest  benefits  to  USACE  is  that  the  ISO  quality  system  stan¬ 
dards  can  be  adopted  with  little  to  no  modification  to  them.  They  are  already 
well-documented,  internationally  recognized,  and  have  stood  the  test  of  time. 
Since  they  were  developed  according  to  private-sector  guidelines  and  can  be 
adapted  to  public-sector  operations,  USACE  does  not  have  to  "reinvent  the 
wheel."  ISO  9000  standards  should  serve  as  the  blueprint  for  ongoing  USACE 
field  office  quality  initiatives. 

The  ISO  9000  standards  can  fulfill  two  roles  for  USACE.  First  they  can  be 
used  to  establish  an  internal  quality  management  system  that  will  reap  signifi¬ 
cant  benefits.  A  standard  quality  system  framework  will  help  to  integrate  all 
other  USACE  quality  initiatives  into  a  coherent  program  that  will  improve  inter¬ 
nal  productivity.  Second,  the  standards  can  be  used  to  improve  the  costs,  timeli¬ 
ness,  and  quality  of  the  products  USACE  receives  from  its  A-E  contractors  and 
other  suppliers  if  it  uses  them  as  a  basis  for  selecting  those  contractors.  The  fol¬ 
lowing  sections  discuss  further  die  implications  of  using  the  ISO  standards  for 
internal  quality  system  improvement  and  external  quality  assurance. 


Interned  Quality  System  Improvements 

Currently,  no  external  customers  demand  (or  will  in  the  foreseeable  future) 
that  USACE  comply  with  any  of  the  ISO  quality  models.  However,  USACE  field 
activities  can  still  receive  significant  benefits  by  establishing  basic  quality  man¬ 
agement  practices  in  their  operations.  The  benefits  of  an  improved  internal 
quality  management  system  and  of  ISO  registration  cannot  be  realized  without  a 
reasonable  investment  of  USACE  resources.  The  typical  USACE  field  office  will 
face  its  biggest  hurdle  in  developing  die  required  ISO-based  procedures,  docu¬ 
menting  those  procedures,  and  properly  training  everyone  in  die  engineering 
community  in  die  new  quality  system  and  standards.  Other  organizations 
about  the  same  size  as  a  typical  USACE  field  office  spend  around  $350,000  (reg¬ 
istration  is  between  $20,000  and  $40,000)  to  meet  ISO  requirements  and  to 
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register,  depending  on  how  broad  die  quality  system  being  audited  is  and  how 
many  tries  are  needed  before  the  held  office  passes  the  audit  We  expect  an 
equivalent  per-site  cost  for  the  first  several  USACE  field  activities  adopting  and 
becoming  registered  to  the  standards. 

However,  USACE  need  not  spend  as  much  for  subsequent  sites  since  many 
of  its  field  activities  share  the  same  engineering  and  design  mission,  the  same 
regulations,  and  perform  die  same  major  engineering  work  processes.  As  activi¬ 
ties  learn  to  adopt  ISO  9000  standards,  create  and  document  the  requisite  proce¬ 
dures,  and  become  comfortable  in  their  applications,  a  valuable  library  of 
documentation  and  lessons  learned  will  emerge.  As  a  result,  subsequent  field 
offices  can  then  simply  modify  die  generic  documentation  with  a  minimal  effort 
instead  of  having  to  develop  their  own  procedures  and  documentation  from 
scratch.  HQUSACE  can  minimize  its  overall  costs  by  first  generating  the  needed 
interest  and  commitment  from  its  leadership  at  field  activities  and  then  develop¬ 
ing  die  needed  implementation  guidance  on  steps  that  must  be  taken  to  register, 
die  generic  procedures  and  quality  documentation  needed  to  comply,  and  the 
required  awareness  training.  Further,  die  actual  cost  of  registration  could  be  re¬ 
duced  by  selecting  a  single  accredited  registrar  to  serve  all  USACE  field  offices 
interested  in  pursuing  ISO  registration.  That  procedure  will  eliminate  die  need 
for  each  field  office  to  identify,  select,  and  contract  with  individual  registrars. 

Successful  implementation  of  an  ISO-registered  quality  management  system 
requires  leadership  commitment  That  commitment  is  better  achieved  when  die 
leadership  is  self-motivated  to  make  die  quality  system  work.  While  USACE 
could  realize  many  of  die  benefits  of  ISO  9000  simply  by  self-regulating  to  the 
standards  (and  not  exposing  its  system  to  outside  registration),  that  approach 
would  require  a  level  of  discipline  and  commitment  that  many  field  offices 
would  find  difficult  to  sustain,  especially  as  their  leadership  changes.  Register¬ 
ing  to  the  ISO  9000  quality  assurance  standards  maximizes  die  opportunity  for 
benefits  by  ensuring  all  elements  of  ISO  9000  quality  systems  are  met,  establish¬ 
ing  a  constancy  of  purpose,  and  sustaining  a  level  of  commitment  from  every¬ 
one  in  die  organization,  including  upper  management  In  that  respect 
registration  to  die  ISO  standards  provides  field  activities  with  die  motivation 
and  incentives  that  self-regulation  does  not  and  it  establishes  a  consistent  qual¬ 
ity  framework  for  continual  improvement  that  would  be  difficult  to  dismantle 
even  in  die  face  of  leadership  changes.  Additionally,  die  incremental  cost  to  reg¬ 
ister  die  quality  management  system  is  minor  compared  with  the  costs  to  com¬ 
ply  with  all  elements  of  die  ISO  standards. 

We  believe  the  benefits  that  field  offices  will  receive  from  registration  will 
outweigh  die  average  implementation  cost  of  around  $350,000  per  site.  The  im¬ 
mediately  quantifiable  benefits  from  establishing  an  ISO-compliant  qualify  sys¬ 
tem  will  come  from  a  reduction  in  lost  design  effort,  lower  reproduction  costs, 
higher  productivity  of  the  in-house  staff,  and,  as  a  result,  a  reduction  of  die  field 
activity's  local  supervision  and  review  (S&R)  rates.  The  following  subsections 
describe  some  of  die  benefits  that  will  accrue  to  die  field  offices  as  a  consequence 
of  their  adopting  the  ISO  standards  and  registering. 


4-3 


A  Successful  Quality  System  Framework 


While  ISO  standards  are  not  the  ultimate  criteria  —  MBNQA  or  the  Presi¬ 
dential  Award  for  Quality  are  more  significant  —  they  establish  the  fundamental 
elements  of  an  unequivocal  quality  management  system.  Adhering  to  die  bask 
20  elements  of  the  ISO  9001  quality  assurance  standard  offers  USACE  field  ac¬ 
tivities  a  proven  formula  for  building  a  foundation  for  their  quality 
systems  —  whether  they  are  just  beginning  their  quality  improvement  efforts  or 
have  a  long-established  tradition  of  quality  management  Since  quality  im¬ 
provement  efforts  at  a  significant  number  of  organizations  fail  for  the  lack  of 
fundamental  quality  system  elements,  adhering  to  die  ISO  9000  standards  offers 
field  offices  the  needed  foundation  upon  which  to  base  their  other  quality 
initiatives  —  TAQ,  for  example. 


Operational  Consistency  and  Product  Uniformity 

The  basic  principles  of  die  ISO  standards  require  that  USACE  field  activities 
document  all  die  procedures  they  currently  use  to  develop  engineering  and  de¬ 
sign  products  and  maintain  the  documented  quality  throughout  die  entire  de¬ 
sign  process.  External  registrars  audit  die  processes  to  ensure  that  documented 
procedures  are  followed.  As  a  result,  procedures  will  be  improved  and  their  ap¬ 
plications  will  be  consistent  because  of  the  documentation.  ISO  does  not  specify 
how  the  designs  should  be  done  or  that  they  be  done  particularly  well;  it  merely 
requires  that  the  designs  be  well  documented  and  that  die  organization  follow 
what  it  has  written. 


Improved  I>xxnvENT  Control 

One  of  the  ISO  standards  is  dedicated  to  document  control  and  will  be  one 
of  the  most  difficult  to  adopt  successfully.  However,  when  USACE  meets  the  in¬ 
tent  of  that  standard,  it  will  have  established  an  effective  means  for  controlling 
all  of  its  essential  documentation.  Effective  document  control  will  improve  pro¬ 
ductivity  and  reduce  design  effort  by  eliminating  circumstances  in  which  out-of- 
date  or  last-revision  design  documents  are  inadvertently  mistaken  for  current 
ones,  for  example. 


Higher  Quality  Engineering  and  Design  Products 

In  documenting  the  design  delivery  processes,  the  implementing  activity  is 
likely  to  uncover  and  correct  inefficiencies,  which  should  lead  to  better  proce¬ 
dures.  Once  the  baseline  is  established,  the  ISO  standards  will  force  the  engi¬ 
neering  organization  to  continually  improve  the  processes  it  uses  to  deliver  its 
engineering  and  design  products  and  services.  The  result  is  higher  quality  proc¬ 
esses,  increases  in  productivity  —  waste  and  rework  are  minimized  —  better 
discipline,  and  higher  quality  products  because  the  organization  must  apply  its 
resources  and  efforts  to  doing  the  right  things.  The  strict  documentation  of 
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procedures  and  records  of  reviews  and  approvals  makes  it  easy  to  focus  on 
problems  and  ensures  that  mistakes  can  be  traced  to  their  origins.  Programs 
such  as  TAQ  that  are  already  in  place  at  many  USACE  field  activities  offer  ideal 
vehicles  for  continually  improving  current  processes.  Others  may  want  to  im¬ 
plement  TAQ,  select  some  other  TQM  program,  or  choose  reengineering  exer¬ 
cises  to  improve  current  processes. 


Improved  Employes  Motivation 

Most  employees  resist  change,  and  adopting  the  ISO  standards  and  institut¬ 
ing  quality  systems  at  USACE  field  activities  will  certainly  result  in  change. 
However,  the  experience  of  other  registered  engineering  and  design  firms  sug¬ 
gests  that  employees  appreciate  die  structure,  documentation,  and  systematic 
procedures  that  die  ISO  standards  demand.  The  basis  of  the  ISO-compliant 
quality  system  is  documentation,  structure,  and  consistent  application  of  those 
procedures.  Most  employees  at  field  activities  would  probably  prefer  to  follow 
established  procedures  than  waste  time  and  effort  figuring  out  how  something 
should  be  done.  For  example,  something  as  simple  as  design  drawing  naming 
conventions,  document  and  revision  numbering,  and  even  die  location  of  tide 
blocks  will  be  documented  and  standardized  under  ISO  9000,  and  once  the  stan¬ 
dard  procedures  are  developed  and  implemented,  most  employees  will  appreci¬ 
ate  their  consistent  application.  An  added  benefit  results  from  including  these 
same  employees  in  the  development  and  codification  of  die  procedures.  Much 
will  be  gained  from  die  increase  in  morale  resulting  from  the  most  basic  aspect 
of  empowerment  In  addition,  actually  creating  die  documentation  gives  em¬ 
ployees  the  opportunity  to  participate  in  tile  development  of  die  processes. 


Better  Customer  Service  and  CoMPEirnvE  Portion 

Satisfaction  is  the  direct  result  of  meeting  or,  better  yet,  exceeding  the  cus¬ 
tomer'  s  expectations  of  service.  The  ISO  standards  will  require  USACE  field  of¬ 
fices  to  involve  their  customers  in  the  design  planning  and  development  process 
and  ensure  that  customer  needs  are  addressed  in  die  design  planning  phase, 
during  design  development,  and  before  designs  are  finalized  and  approved. 
Thus,  it  follows  that  customer  service  and  customer  satisfaction  will  improve. 
The  side  benefit  is  that  die  lines  of  communication  with  its  customers  will  be  ex¬ 
panded.  Higher  customer  satisfaction  brings  higher  customer  loyalty. 

Some  USACE  districts  are  beginning  to  compete  for  work.  Some  of 
USACE's  customers  are  starting  to  shop  around  for  the  district  or  outside  engi¬ 
neering  firm  that  will  give  them  the  best  "deal"  on  costs,  service,  and  quality. 
Districts  that  can  demonstrate  a  quality  system  that  complies  with  the  ISO  stan¬ 
dards  will  have  an  advantage  over  districts  or  other  engineering  firms  that  do 
not,  and  districts  that  provide  excellent  service  will  retain  customers  that  other¬ 
wise  may  have  looked  elsewhere  or  for  other  alternatives  for  getting  work  done. 
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The  Corps  customers  should  not  be  expected  to  determine  the  benefits  of 
ISO  registration  for  themselves.  USACE  must  educate  diem  on  die  significance 
of  ISO  quality  systems.  While  TAQ  certainly  has  its  place  in  USACE's  total 
quality  efforts,  simply  saying  that  you  have  TAQ  provides  little  tangible  proof  to 
customers.  ISO  registration,  on  die  other  hand,  does  provide  that  tangible  proof 
that  bona  fide  quality  systems  are  a  part  of  everyday  operations  and  the  cus¬ 
tomer'  s  requirements  for  quality  will  likely  be  met 


Improved  Image  and  Recognition 

Registration  under  the  ISO  standards  demonstrates  to  existing  and  potential 
USACE  customers  and  its  peers  in  the  engineering  community  that  it  is  truly 
committed  to  quality  management  and  customer  service.  No  longer  could  they 
question  USACE's  commitment  to  quality.  The  ISO  registration  proves  to  die 
rest  of  the  industry  and  its  customers  that  USACE  takes  quality  seriously.  The 
registration  legitimizes  its  quality  initiatives  and  has  die  backing  of  private- 
sector  and  internationally  recognized  authorities.  The  ISO  registration  opens 
doors  that  might  otherwise  remain  closed.  Registration  will  permit  the  field  ac¬ 
tivity  to  advertise  its  accomplishments  in  all  brochures,  letters,  and  literature 
and  can  be  used  as  a  marketing  tool  for  informing  USACE's  existing  and  poten¬ 
tial  customers  about  its  accomplishments  in  quality  management  and  customer 
service. 


Keeps  Options  Open 

The  ISO  registration  phenomenon  is  growing  rapidly  throughout  the  world. 
Nearly  every  industrialized  country  has  now  adopted  die  ISO  standards  as  its 
national  quality  system  standards.  In  the  United  States,  die  ISO  standards  are 
gaining  increasing  acceptance  throughout  industry  and  the  government  DoD 
has  already  established  an  ISO  task  force  to  determine  the  role  that  the  stan¬ 
dards  should  play  in  the  military  establishment  The  North  American  Free 
Trade  Agreement  (NAFTA)  is  considering  the  use  of  ISO  standards  to  provide 
quality  assurance  across  the  borders.  Where  all  this  is  leading  is  still  uncertain 
and  will  not  be  known  for  another  6  to  12  months  or  longer.  While  die  U.S. 
Government,  DoD,  or  USACE's  customers  are  not  requiring  ISO  certification  to¬ 
day,  we  cannot  say  conclusively  that  at  least  some  of  those  customers  or  poten¬ 
tial  customers  will  not  require  or  encourage  such  certification  in  die  future.  If  its 
customers  begin  to  require  registration  or  it  finds  that  registration  gives  field  ac¬ 
tivities  a  competitive  advantage  over  those  that  are  not  registered,  USACE  will 
already  be  in  a  position  to  meet  that  demand. 


Less  Effort  to  manage  at  HQUSACE 

Where  field  activities  register  to  ISO,  the  burden  of  audits,  recommended 
system  improvements,  monitoring  of  results,  and  system  reassessments  falls  on 
the  independent  ISO  registrar  chosen  by  the  field  activities.  HQUSACE  will 
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simply  need  to  monitor  the  status  of  field  activities  seeking  registration  and  pro¬ 
vide  tiie  necessary  policy  and  guidance  related  to  ISO  registration. 


Motivation  Toward  a  Goal 

Most  organizations  that  set  out  to  register  finally  do  so  and  because  they 
have  put  time  and  effort  into  complying  with  the  registration  requirements,  their 
quality  system  is  improved  and  the  benefits  cited  here  are  realized.  Registration 
to  ISO  9000  will  establish  a  quality  system  goal  that,  once  undertaken,  the  field 
activities  will  make  every  effort  to  meet  Field  activities  that  register  successfully 
are  likely  to  maintain  their  registration  even  as  top  leadership  changes.  With  an 
established  quality  management  system  that  is  dependent  on  periodic  reassess¬ 
ment  audits,  new  management  will  be  hard  pressed  to  find  reasons  to  discon¬ 
tinue  the  quality  practice. 


Quality  Assurance  of  Architect-Engineering  Contractors 

Another  use  for  the  ISO  standards  is  external  quality  assurance.  The  objec¬ 
tive  of  such  a  quality  assurance  program  is  to  ensure  the  products  that  USACE 
receives  from  its  A-E  contractors  and  suppliers  consistently  conform  to  specified 
requirements.  That  means  getting  engineering  and  design  products  that  meet 
USACE' s  and  its  customer's  quality,  cost,  schedule,  and  functional  require¬ 
ments.  To  meet  that  need,  USACE  currently  requires  A-E  contractors  to  submit 
a  quality  control  plan  along  with  other  submittals  for  each  contracted  project 
that  demonstrates  how  the  firm  will  respond  to  USACE' s  requirements  with  re¬ 
spect  to  quality.  USACE  field  activities  review  those  plans  for  sufficiency  during 
the  A-E  selection  process.  Firms  must  meet  the  requirement  or  they  will  be 
eliminated  from  further  consideration.  The  problem  with  this  method  is  that  af¬ 
ter  selection  and  final  negotiations,  the  A-E  firm  awarded  the  contract  may  not 
live  up  to  the  level  of  quality  that  they  clearly  document  in  their  quality  plan. 

Instead  of  relying  solely  on  the  quality  control  plans  submitted  by  A-E  con¬ 
tractors,  USACE  can  begin  considering  registration  to  one  of  the  ISO  quality  as¬ 
surance  standards  (ISO  9001  or  ISO  9002)  as  part  of  the  selection  criteria  during 
A-E  selection.  Firms  that  are  registered  to  the  ISO  standard  are  held  to  the  same 
strict  quality  system  requirements  previously  discussed  and  therefore  are  better 
able  to  meet  USACE's  quality  demands.  Registered  A-E  firms  would  not  have 
to  submit  the  same  detailed  quality  control  plans  as  unregistered  firms  since  ac¬ 
credited  independent  auditors  would  have  already  verified  that  the  A-E  firms 
have  established  quality  practices  in  place.  Perhaps  the  quality  manual  required 
by  ISO  along  with  a  project-specific  quality  plan  would  be  all  that  is  needed. 
Firms  that  are  not  registered  should  be  required  to  submit  quality  control  plans 
that  address  each  of  the  quality  system  elements  contained  in  ISO  9001  for  qual¬ 
ity  management  processes  and,  in  addition,  information  on  how  they  intend  to 
meet  schedule  and  costs  for  particular  projects.  In  addition  to  simplifying  the 
evaluation  of  its  A-E  contractors,  USACE  leadership  will  be  sending  a  clear  mes¬ 
sage  to  the  engineering  and  design  industry  —  USACE  takes  quality  seriously. 
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Promoting  the  ISO  standards  as  its  quality  assurance  mechanism  will  further  en¬ 
hance  its  image  as  a  world-class  organization.  A  statement  for  promulgation  in 
the  Commerce  Business  Daily  (CBD)  is  shown  in  Figure  4-1. 


ran  Announcement 

. . .  “We  are  a  total  quality  organization  and  we  prefer  to 
work  with  contractors  who  are  equally  committed  to  quality 
management  The  selection  of  the  most  qualified  A-E  con¬ 
tractor  will  be  partly  based  on  the  contractor’s  ability  to  meet 
the  ISO  9000  quality  standards.  Consideration  will  be  given 
to  firms  already  registered  to  ISO  9001  quality  assurance 
standards  or  to  firms  whose  quality  management  plans  con¬ 
form  to  the  ISO  standards.’'. . . 


Figure  4-1. 

Possible  CBD  Announcement 


Recommendations 

While  a  great  deal  of  evidence  supports  the  claim  that  private  industry  is 
experiencing  significant  cost  savings  and  benefits  from  adopting  and  registering 
to  the  ISO  9000  quality  system  standards,  we  have  little  actual  experience  from 
Federal  agencies.  We  believe  that  USAGE  field  activities  will  also  realize 
exceptional  quantifiable  benefits  from  putting  the  ISO  quality  system  elements 
into  action.  However,  because  the  USACE  engineering  and  design  processes 
function  under  government  regulations  and  in  a  bureaucracy,  we  recommend  a 
somewhat  more  cautious  approach  to  adopting  the  ISO  9000  quality  framework. 
We  recommend  that  USACE  begin  implementing  the  following  strategy  for 
improving  its  quality  management  systems  using  the  ISO  9000  quality  system 
standards. 

♦  HQUSACE  should  evaluate  the  costs  and  benefits  of  ISO  registration  at  two  to  Jour 
test  sites  (field  activities)  to  determine  whether  ISO  registration  should  be  generally 
encouraged  at  all  USACE  field  actimties.  The  actual  savings  that  USACE  field 
offices  will  generate  as  a  direct  result  of  registering  to  ISO  9000  standards  is 
still  uncertain.  Since  costs  to  emplace  ISO  9000  standards  could  exceed 
$350,000  per  site,  we  recommend  that  USACE  proceed  with  ISO  implemen¬ 
tation  cautiously.  Since  some  USACE  districts  have  already  expressed  in¬ 
terest  in  adopting  the  ISO  standards,  we  suggest  that  two  to  four  of  those 
sites  be  selected  to  test  toe  concept  The  pilot  locations  will  establish  a  base¬ 
line  for  evaluating  toe  costs  and  benefits  of  ISO  registration  using  metrics 
such  as  lost  design,  S&R  rates,  and  customer  satisfaction  and  awareness,  for 
example.  HQUSACE  should  support  toe  registration  goal  by  funding  toe 
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development  and  documentation  of  the  required  ISO-qualified  processes  as 
well  as  developing  the  awareness  training  needed  to  educate  the  employees 
about  ISO.  In  support  of  that  goal,  HQUSACE  needs  to  establish  an  imple¬ 
mentation  strategy  for  the  pilot  locations.  The  strategy  should  typically  in¬ 
clude  a  detailed  plan  of  action,  criteria  used  to  evaluate  success  or  failure, 
estimated  costs  for  ISO  implementation  and  registration,  an  outline  of  re¬ 
sponsibilities,  and  a  plan  for  expanding  the  quality  initiatives  beyond  the 
engineering  domain.  A  strategy  should  also  be  developed  that  will  move 
USACE  field  activities  beyond  the  minimum  quality  requirements  estab¬ 
lished  by  ISO  9000  toward  the  world-class  quality  systems  embodied  by  the 
MBNQA  and  the  Presidential  Award  for  Quality.  Successful  field  activities 
should  promote  their  success  in  trade  journals,  newsletters,  and  other  in¬ 
dustry  forum  to  make  sure  the  message  is  well  received  in  the  engineering 
industry  and  throughout  its  customer  base. 

♦  If  emplacement  of  ISO  9000  standards  is  found  to  be  justified  at  the  test  locations, 
USACE  should  encourage  all  field  offices  to  begin  seeking  registration  to  the  ISO 
9001  quality  assurance  standards.  If  the  benefits  realized  by  the  pilot  sites  can 
justify  the  total  costs  to  implement  and  maintain  registration,  HQUSACE 
should  initiate  a  program  to  register  all  of  its  field  activities  that  want  to  be¬ 
come  registered.  HQUSACE  should  make  the  field  offices  aware  of  die  ISO 
standards,  the  benefits  of  quality  management  systems,  and  the  costs  of 
adopting  and  registering  to  the  ISO  standards.  Promotion  of  file  ISO  stan¬ 
dards  by  HQUSACE  is  imperative  to  the  success  of  the  initiative.  Since  suc¬ 
cess  cannot  be  mandated  from  the  top,  leadership  at  field  activities  must  be 
internally  motivated  to  adopt  what  may  be  a  dramatically  new  way  of  do¬ 
ing  business.  HQUSACE  should  consider  creating  recognition  and  incen¬ 
tive  programs  to  acknowledge  those  field  activities  that  have  become 
registered. 

♦  From  the  procedures,  documentation,  and  awareness  training  developed  for  the  test 
sites,  HQUSACE  should  generate  documentation  templates  that  can  be  readily 
adapted  by  any  USACE  field  activity  wishing  to  become  registered.  Templated 
procedures  will  go  a  long  way  in  simplifying  registration  for  subsequent 
field  activities  wishing  to  do  so.  As  a  result,  file  per-site  costs  can  be  signifi¬ 
cantly  reduced.  Implementation  guidance  should  also  be  developed  to  as¬ 
sist  the  field  activities  with  a  step-by-step  approach  for  becoming  registered. 

♦  The  USACE  should  begin  including  ISO  registration  as  a  weighted  criterion  in  the 
A-E  selection  process.  Independent  of  using  the  ISO  standards  to  improve  in¬ 
ternal  quality  systems,  HQUSACE  should  encourage  the  use  of  file  stan¬ 
dards  for  external  quality  assurance.  Currently,  too  few  A-E  firms  are 
ISO-registered  to  require  ISO  registration  in  the  selection  process.  But  at 
this  time,  by  encouraging  ISO  registration,  USACE  will  be  sending  a  clear 
message  that  quality  is  something  that  USACE  takes  seriously  and  that  in 
the  future  only  A-E  firms  that  are  equally  committed  to  quality  will  be  con¬ 
sidered  in  the  selection  process.  Their  registrations  to  the  ISO  standards 
will  demonstrate  their  commitment. 
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The  USACE  is  the  world's  largest  engineering  and  design  firm  with  a  new 
challenging  mission  to  deliver  the  total  quality  its  customers  expect  Quality 
means  engineering  organizations  at  USACE  field  activities  must  deliver  prod¬ 
ucts  that  meet  their  customers'  functional  and  technical  needs,  on  schedule,  and 
within  a  competitive  cost  A  growing  number  of  USACE  customers  are  no 
longer  captive;  they  are  finding  alternative  ways  to  get  their  work  accomplished. 
If  USACE  expects  to  keep  its  customers  and  even  attract  new  ones,  its  field  ac¬ 
tivities  must  embrace  the  concepts  of  total  quality  and  customer  service.  The 
quality  of  its  product  will  be  a  major  factor  in  determining  whether  those  cus¬ 
tomers  choose  to  use  USACE  or  get  their  work  done  elsewhere.  Adopting  the 
ISO  9000  standards  is  the  first  step  toward  ensuring  that  fundamental  quality 
management  practices  are  well  established  at  USACE  field  activities  and  that 
they  become  the  core  of  USACE  business  practices.  From  that  solid  quality 
foundation,  other  quality  initiatives  can  better  succeed  and  help  to  move  USACE 
toward  the  world-class  engineering  organization  that  it  needs  to  be. 
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Total  Army  Quality  in  the  U.S.  Army 

Corps  of  Engineers 


DEPARTMENT  OF  THE  ARMY 

UJ.  Army  Caw  •*  t*|lwwrt 
WASHINGTON.  OX.  20314*1000 


MN.VTO 
ATTCNTION  Q#i 


22  APR  1993 


MEMORANDUM  FOR  Commanders,  USACE  Commands 

SUBJECT:  Total  Army  Quality  in  the  U.  S.  Army  Corps  of  Engineers 


1.  References: 

a.  AR  5-1,  Army  Management  Philosophy,  12  June  1992. 

b.  Leadership  for  Total  Army  Quality  (Enel). 

2.  Despite  this  time  of  uncertainty  and  turbulence  the  USACE 
team  has  demonstrated  that  our  tradition  remains  strong.  We 
remain  strong  because  of  the  ability  of  our  people  to  rise  to 
meet  great  challenges,  to  skillfully  address  our  nation's 
national  security  and  domestic  needs,  and  to  identify 
opportunities  for  innovation  and  initiative. 

3.  Total  Army  Quality  (TAQ)  is  a  means  for  us  to  equip  our 
people  with  the  necessary  skills  to  enhance  our  effectiveness. 

A  number  of  organizations  have  already  begun  to  implement  the 
principles  of  this  leadership  and  management  philosophy. 

We  can  learn  from  their  experience  as  we  implement  TAQ  across 
the  command.  I  encourage  you  to  adopt  the  TAQ  concept  and 
ask  you  to  determine  how  best  to  implement  it  within  your 
organization. 

4.  As  we  embark  upon  this  mutual  endeavor,  we  must  keep  in 
mind  that  TAQ  is  not  a  program  and  that  Implementation  is 
the  responsibility  of  all  leaders  and  managers.  I  have  asked 
the  Director  of  Resource  Management  to  provide  coordination  and 
liaison  during  the  initial  phases  of  implementation.  He  has 
established  an  electronic  network  to  facilitate  sharing  ideas 
and  lessons- learned.  Information  about  this  network  will  be 
distributed  separately. 

5.  You  have  my  fullest  support  in  this  effort.  1  look  forward 
to  hearing  about  your  successes. 


Enel  ARTHUR  E.  WILLIAMS 

Lieutenant  General,  USA 
Commanding 
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The  ISO  Standards 


ANSI/ASQC  Standard  Q91-1987 


QUALITY  SYSTEMS  -  MODEL  FOR  QUALITY  ASSURANCE  IN 
DESIGN/DEVELOPMENT,  PRODUCTION,  INSTALLATION,  AND  SERVICING 


0.0  INTRODUCTION 

This  Standard  is  one  of  a  series  of  three  Standards  dealing 
with  quality  systems  that  can  be  used  for  external  quality 
assurance  purposes.  The  alternative  quality  assurance  models, 
set  out  in  the  three  Standards  fisted  below,  represent  three 
distinct  forms  of  functional  or  organizational  capability 
suitable  for  two-party  contractual  purposes: 

-  ANSI/ASQC  Q91-1987.  Quality  Systems  -  Model  for 
Quality  Assurance  in  Design/Development,  Production, 
Installation,  and  Servicing. 

For  use  when  conformance  to  specified  requirements  is 
to  be  assured  by  the  supplier  during  several  stages  which 
may  include  design/development,  production,  installa¬ 
tion,  and  servicing. 

-  ANSI/ASQC  Q92-1987,  Quality  Systems  -  Model  for 
Quality  Assurance  in  Production  and  Installation. 

For  use  when  conformance  to  specified  requirements  is 
to  be  assured  fay  the  supplier  during  production  and 
installation. 

—  ANSI/ASQC  Q93-1987,  Quality  Systems  —  Model  for 
Quality  Assurance  in  Final  Inspection  and  Test. 

For  use  when  conformance  to  specified  requirements  is 
to  be  assured  fay  the  supplier  solely  at  final  inspection 
and  test. 

It  is  emphasized  that  the  quality  system  requirements  specified 
in  this  Standard,  Standards  Q92  and  Q93  are  complemen¬ 
tary  (not  alternative)  to  the  technical  (product/service) 
specified  requirements.  These  Standards  are  technically 
equivalent  to  the  International  Standards  ISO  9001, 9002,  and 
9003  respectively. 

It  is  intended  that  these  Standards  will  normally  be  adopted 
in  their  present  form,  but  on  occasions  they  may  need  to  be 
tailored  for  specific  contractual  situations.  Q90  provides 
guidance  on  such  tailoring  as  well  as  selection  of  the  ap¬ 
propriate  quality  assurance  model,  namely  Q91,  Q92,  or  Q93. 

1.0  SCOPE  AND  FIELD  OF  APPLICATION 

1.1  Scope 

This  Standard  specifies  quality  system  requirements  for  use 
where  a  contract  between  two  parties  requires  the  demonstra¬ 
tion  of  a  supplier's  capability  to  design  and  supply  product. 


The  requirements  specified  in  this  Standard  are  aimed 
primarily  at  preventing  nonconformity  at  all  stages  from 
design  to  servicing. 

1.2  Field  of  Application 

This  Standard  is  applicable  in  contractual  situations  when: 

a)  the  contract  specifically  requires  design  effort  and  the  prod¬ 
uct  requirements  are  stated  principally  in  performance 
terms  or  they  need  to  be  established; 

b)  confidence  in  product  conformance  can  be  attained  fay  ade¬ 
quate  demonstration  of  certain  supplier's  capabilities  in 
design,  development,  production,  installation,  and  servic¬ 
ing. 

2j0  REFERENCES 

ANSI/ASQC  A3,  Quality  Systems  Terminology. 

ISO  8402-1986,  Quality  —  Vocabulary. 

ANSI/ASQC  Q90-1987  Quality  Management  and  Quality 
Assurance  Standards  —  Guidelines  for  Selection  and  Use. 
ISO  9000-1987,  Quality  Management  and  Quality  Assurance 
Standards  —  Guidelines  for  Selection  and  Use. 

3u0  DEFINITIONS 

For  the  purposes  of  this  Standard,  the  definitions  given  in 
ANSI/ASQC  A3  apply. 

NOTE:  For  the  purposes  of  this  Standard,  the  term  “prod¬ 
uct’'  is  also  used  to  denote  “service,”  as  appropriate. 

4j0  QUALITY  SYSTEM  REQUIREMENTS 

4.1  Management  Responsibility 

4.1.1  Quality  Folky 

The  supplier's  management  shall  define  and  document  its 
policy  and  objectives  for,  and  commitment  to.  quality.  The 
supplier  shall  ensure  that  this  policy  is  understood,  im¬ 
plemented,  and  maintained  at  all  levels  in  the  organization. 

4.1.2  Organization 

4.1.2.1  Responsibility  and  Authority 

The  responsibility,  authority,  and  the  interrelation  of  all 

personnel  who  manage,  perform,  and  verify  work  affecting 
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quality  shall  be  defined;  particularly  for  personnel  who  need 
die  organizational  freedom  and  authority  to: 

a)  initiate  action  to  prevent  the  occurrence  of  product 
nonconformity; 

b)  identify  and  record  any  product  quality  problems; 

c)  initiate,  recommend,  or  provide  solutions  through  desig¬ 
nated  channels; 

d)  verify  the  implementation  of  solutions; 

e)  control  further  processing,  delivery,  or  installation  of  non¬ 
conforming  product  until  the  deficiency  or  unsatisfactory 
condition  has  been  corrected. 

4. 1.2. 2  Verification  Resources  and  Rersoond 

The  supplier  shall  identify  in-house  verification  requirements, 
provide  adequate  resources,  and  assign  trained  personnel  for 
verification  activities  (see  4.18). 

Verification  activities  shall  include  inspection,  test,  and 
monitoring  of  the  design,  production,  installation,  and  ser¬ 
vicing  of  the  process  and/or  product;  design  reviews  and 
audits  of  the  quality  system,  processes,  and/or  product  shall 
be  carried  out  by  personnel  independent  of  those  having  direct 
responsibility  for  the  work  being  performed. 

4.1.2J  Management  Representative 

The  supplier  shall  appoint  a  management  representative  who, 
irrespective  of  other  responsibilities,  shall  have  defined  au¬ 
thority  and  responsibility  for  ensuring  that  the  requirements 
of  this  Standard  are  implemented  and  maintainwH 

4.1.3  Management  Review 

The  quality  system  adopted  to  satisfy  the  requirements  of  this 
Standard  shall  be  reviewed  at  appropriate  intervals  by  the  sup¬ 
plier's  management  to  ensure  its  continuing  suitability  and 
effectiveness.  Records  of  such  reviews  shall  be  maintained 
(see  4.16). 

NOTE:  Management  reviews  normally  include  assessment 
of  the  results  of  internal  quality  audits,  but  are  carried  out 
by,  or  on  behalf  of,  the  supplier’s  management,  namely 
management  personnel  having  direct  responsibility  for  the 
system  (see  4.17). 

4.2  Quality  System 

The  supplier  shall  establish  and  maintain  a  documented  qual¬ 
ity  system  as  a  means  of  ensuring  that  product  conforms  to 
specified  requirements.  This  shall  include: 

a)  the  preparation  of  documented  qualify  system  procedures 
and  instructions  in  accordance  with  the  requirements  of 
this  Standard; 


b)  the  effective  implementation  of  the  documented  quality 
system  procedures  and  instructions. 

NOTE:  In  meeting  specified  requirements,  timely  comidera- 
tkm  needs  to  be  given  to  the  following  activities: 

a)  the  preparation  of  quality  plans  and  a  quality  manual  in 
accordance  with  the  specified  requirementt; 

b)  the  identification  and  acquisition  of  any  controls,  pro¬ 
cesses,  inspection  equipment,  fixtures,  total  production 
resources,  and  «mis  that  may  be  needed  to  achieve  the 
required  quality; 

c)  the  updating,  as  necessary,  of  quality  control,  inspection, 
and  testing  techniques,  including  the  development  of  new 
instrumentation; 

d)  the  identification  of  any  measurement  requirement  involv¬ 
ing  capability  that  exceeds  the  known  state  of  die  art  in 
sufficient  time  for  the  needed  capability  to  be  developed; 

e)  the  clarification  of  standards  of  acceptability  for  aD  fea¬ 
tures  and  requirements,  including  those  which  contain  a 
subjective  dement; 

0  the  compatibility  of  the  design,  die  production  process, 
installation,  inspection  and  test  procedures,  and  the  ap¬ 
plicable  documentation; 

g)  the  identification  and  preparation  of  quality  records  (see 
4.16). 

4J  Contract  Review 

The  supplier  shall  establish  and  maintain  procedures  for  coo- 
tract  review  and  for  the  coordination  of  these  activities. 

Each  contract  shall  be  reviewed  by  the  supplier  to  ensure  dwt: 

a)  the  requirements  are  adequately  defined  and  documented; 

b)  any  requirements  differing  from  those  in  the  tender  are 
resolved; 

c)  the  supplier  has  the  capability  to  meet  contractual 
requirements. 

Records  of  such  contract  reviews  shall  be  maintained  (see 
4.16). 

NOTE:  The  contract  review  activities,  interfaces,  and  com¬ 
munication  within  die  supplier's  organization  should  be  coor¬ 
dinated  with  the  purchaser’s  organization,  as  appropriate. 

4.4  Design  Control 
4.4.1  General 

The  supplier  shall  establish  and  maintain  procedures  to  con¬ 
trol  and  verify  the  design  of  the  product  in  order  to  ensure 
that  the  specified  requirements  are  met. 
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The  supplier  shall  draw  up  plana  that  identify  the  napoo- 
sibality  far  each  design  and  development  activity.  The  plana 
shall  describe  or  reference  these  activities  and  shall  be  up¬ 
dated  as  the  design  evolves. 

4.4.2. 1  Activity  Assignment 

The  design  and  verification  activities  shall  be  planned  and 
assigned  to  qualified  staff  equipped  with  adequate  resources. 

4.4JJ  Organizational  and  Technical  Interfaces 
Organizational  and  technical  interfaces  between  different 
groups  shell  be  identified  and  die  necessary  information 
documented,  transmitted,  and  regularly  reviewed. 

4A3  Design  Input 

Design  input  requirements  relating  to  the  product  shall  be 
identified,  documented,  and  their  selection  reviewed  fay  the 
supplier  for  adequacy. 

Incomplete,  ambiguous,  or  conflicting  requirements  shall  be 
resolved  with  those  rcsponsibte  for  drawing  up  these  require¬ 
ments. 

4A4  Design  Output 

Design  output  shall  be  documented  and  expressed  in  terms 
of  requirements,  calculations,  and  analyses. 

Design  output  shall: 

a)  meet  the  design  input  requirements: 

b)  contain  or  reference  acceptance  criteria; 

c)  conform  to  appropriate  regulatory  requirements  whether 
or  not  these  have  been  stated  in  the  input  information: 

d)  identify  those  characteristics  of  the  design  that  are  crucial 
to  the  safe  and  proper  functioning  of  the  product. 

44i  Design  Verification 

The  supplier  shall  plan,  establish,  document,  and  assign  to 
competent  personnel  functions  for  verifying  the  design. 

Design  verification  shall  establish  that  design  output  meets 
the  design  input  requirement  (see  4.4.4)  by  means  of  design 
control  measures  such  as: 

a)  holding  and  recording  design  reviews  (see  4.16); 

b)  undertaking  qualification  tests  and  demonstrations; 

c)  carrying  out  alternative  calculations; 

d)  comparing  the  new  design  with  a  similar  proven  design, 
if  available. 


The  tnbttsh  nd  nnimia  pcocedBfcs  for  the 

rifjiilkjflofl,  documrnniinfl,  end  ipprapriiie  review  nd  ep* 
proval  of  aQ  changes  and  modifications. 

4i  Document  Control 

4.5.1  Document  Approval  and  Isanc 

The  supplier  shall  establish  and  maintain  procedures  to  con¬ 
trol  all  documents  and  data  that  relate  to  the  requirement 
of  this  Standard.  These  documents  shall  be  reviewed  and  ap¬ 
proved  for  adequacy  by  authorized  personnel  prior  to  issue. 
This  control  shall  ensure  that: 

a)  the  pertinent  issues  of  appropriate  documents  are  Milabie 
at  tH  locations  where  operations  essential  to  the  effective 
functioning  of  the  quality  system  are  performed: 

b)  obsolete  document  are  promptly  removed  from  all  points 
of  issue  or  use. 

4JL2  Document  OangnfModMhUa— 

Changes  to  documemshall  be  reviewed  and  approved  by  the 
tame  ftmetions/organizations  that  performed  the  original 
review  and  approval  unless  specifically  designaeed  otherwise. 
The  designated  otganhations  shall  have  access  to  pertinent 
background  information  npon  which  to  base  their  review  nut 
approval. 

Where  practicable,  the  nature  of  the  change  shall  be  iden¬ 
tified  in  the  document  or  the  appropriate  attachments. 

A  master  list  or  equivilendocumen  control  procedure  thaP 
be  established  to  identify  the  curren  revision  of  document 
in  order  to  preclude  the  use  of  non-applicable  documents. 

Documents  shall  be  re-issued  after  a  practical  number  of 
changes  have  been  nuik 

44  Purchasing 

4.6.1  General 

The  supplier  shall  ensure  that  purchased  product  conforms 
to  specified  requirements. 

441  Assessment  of  Sob-Contractors 

The  supplier  shall  select  sub-contractor*  oo  the  basis  of  their 
ability  to  meet  sub-contract  requirements,  including  quality 
requirements.  The  supplier  shall  establish  and 
records  of  acceptable  sub-contractors  (see  4.16). 

The  selection  of  sub-contractors,  and  the  type  and  extent  of 
control  exercised  by  the  supplier,  shall  be  dependent  upon 
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the  type  of  product  and.  where  appropriate,  on  records  of 
subcontractors’  previously  demonstrated  capability  and  per¬ 
formance. 

The  supplier  shall  ensure  that  quality  system  controls  are 
effective. 

4j6l3  Purchasing  Data 

Purchasing  documents  shall  contain  data  clearly  describing 
the  product  ordered,  including,  where  applicable: 

a)  the  type,  class,  style,  grade,  or  other  precise  identification; 

b)  the  title  or  other  positive  identification,  and  applicable 
issue  of  specifications,  drawings,  process  requirements, 
inspection  instructions,  and  other  relevant  technical  data, 
including  requirements  for  approval  or  qualification  of 
product,  procedures,  process  equipment  and  personnel; 

c)  the  title,  number,  and  issue  of  the  quality  system  Standard 
so  be  applied  to  the  product 

The  supplier  shall  review  and  approve  purchasing  documents 
for  adequacy  of  specified  requirements  prior  to  release. 

mncsnoo  ov  rarcnssca  rToaucs 

Where  specified  in  the  contract,  the  purchaser  or  the  pur¬ 
chaser’s  representative  shall  be  afforded  the  right  to  verify 
at  source  or  upon  receipt  that  purchased  product  conforms 
to  specified  requirements.  Verification  by  the  purchaser  shall 
not  absolve  the  supplier  of  the  responsibility  to  provide  ac¬ 
ceptable  product  nor  shall  it  preclude  subsequent  rejection. 

When  the  purchaser  or  the  purchaser’s  representative  elects 
to  carry  out  verification  at  the  sub-contractor's  plant,  such 
verification  shall  not  be  used  by  die  supplier  as  evidence  of 
effective  control  of  quality  fay  the  sub-contractor. 

4.7  Purchaser  Supplied  Product 
The  supplier  shall  establish  and  maintain  procedures  for 
verification,  storage,  and  maintenance  of  purchaser  supplied 
product  provided  for  incorporation  into  the  supplies.  Any  such 
product  that  is  lost,  damaged,  or  is  otherwise  unsuitable  for 
use  shall  be  recorded  and  reported  to  the  purchaser  (see  4.16). 

NOTE;  Verification  by  the  supplier  does  not  absolve  the  pur¬ 
chaser  of  the  responsibility  to  provide  acceptable  product. 

41  Product  Identification  and  Traceability 

Where  appropriate,  the  supplier  shall  establish  and  maintain 
procedures  for  identifying  the  product  from  applicable  draw¬ 
ings,  specifications,  or  other  documents,  during  all  stages  of 
production,  delivery,  and  installation. 

Where,  and  to  the  extent  that,  traceability  is  a  specified  re¬ 


quirement.  individual  product  or  batchy  shell  have  a  unique 
identification.  This  identification  shall  be  recorded  (see  4.16). 

4J  Process  Control 

4.9.1  General 

The  supplier  shall  identify  and  plan  the  production  and,  where 
applicable,  installation  processes  which  directly  affect  quality 
and  shall  ensure  that  these  processes  are  carried  out  under 
controlled  conditions.  Controlled  conditions  shall  include  the 
following: 

a)  documented  work  instructions  defining  the  manner  of  pro¬ 
duction  and  installation,  where  the  absence  of  such  instruc¬ 
tions  would  adversely  affect  quality,  use  of  suitable  pro¬ 
duction  and  installation  equipment,  suitable  working 
environment,  compliance  with  reference  standaids/codes, 
and  quality  plans; 

b)  monitoring  and  control  of  suitable  process  and  product 
characteristics  during  production  and  installation; 

c)  the  approval  of  processes  and  equipment,  as  appropriate; 

d)  criteria  for  workmanship  which  shall  be  stipulated,  to  the 
greatest  practicable  extent,  in  written  standards  or  by 
means  of  representative  samples. 

4X2  Special  Preceaacs 

These  are  processes,  the  results  of  which  cannot  be  folly 
verified  by  subsequent  inspection  and  testing  of  the  product 
and  where,  for  example,  processing  deficiencies  may  become 
apparent  only  after  die  product  is  in  use.  Accordingly,  con¬ 
tinuous  monitoring  and/or  compliance  with  documented  pro¬ 
cedures  is  required  to  ensure  that  the  specified  requirements 
are  met.  These  processes  shall  be  qualified  and  shall  also 
comply  with  the  requirements  of  4.9.1. 

Records  shall  be  maintained  for  qualified  processes,  equip¬ 
ment,  and  personnel,  as  appropriate. 

4.10  Inspection  and  Testing 

4.10.1  Receiving  Inspection  and  Testing 

4.10.1.1  The  supplier  shall  ensure  that  incoming  product  is 
not  used  or  processed  (except  in  the  circumstances  described 
in  4.KX1.2)  until  it  has  been  inspected  or  otherwise  verified 
as  conforming  to  specified  requirements.  Verification  shall 
be  in  accordance  with  the  quality  (dan  or  documented 
procedures. 

4.10.1.2  Where  incoming  product  is  released  for  uigem  pro¬ 
duction  purposes,  it  shall  be  positively  identified  and  recorded 
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(tee  4.16)  in  order  to  permit  immediate  recall  and  replace¬ 
ment  in  the  event  of  nonconformance  to  specified  require¬ 
ments. 

NOTE:  In  determining  the  amount  and  nature  of  receiving 
inspection,  consideration  should  be  given  to  the  control  ex¬ 
ercised  at  source  and  documented  evidence  of  quality  con¬ 
formance  provided. 

4.10.2  In-Process  Inspection  and  Testing 
The  supplier  shall: 

a)  inspect,  test,  and  identify  product  as  required  by  the  qual¬ 
ity  plan  or  documented  procedures; 

b)  establish  product  conformance  to  specified  requirements 
by  use  of  process  monitoring  and  control  methods; 

c)  hold  product  until  the  required  inspection  and  tests  have 
been  completed  or  necessary  reports  have  been  received 
and  verified  except  when  product  is  released  under  positive 
recall  procedures  (see  4.KU).  Release  under  positive  recall 
procedures  shall  not  preclude  the  activities  outlined  in 

4.10.2  a); 

d)  identify  nonconforming  product. 

4.10.3  Final  Inspection  and  Iksting 

The  quality  plan  or  documented  procedures  for  final  inspec¬ 
tion  and  testing  shall  require  that  all  specified  inspection  and 
tests,  including  those  specified  either  on  receipt  of  product 
or  in-process,  have  been  carried  out  and  that  the  data  meets 
specified  requirements. 

The  supplier  shall  carry  out  all  final  inspection  and  testing 
in  accordance  with  the  quality  plan  or  documented  procedures 
to  complete  the  evidence  of  conformance  of  the  finished  prod¬ 
uct  to  the  specified  requirements. 

No  product  shall  be  dispatched  until  all  the  activities  specified 
in  die  quality  plan  or  documented  procedures  have  been 
satisfactorily  completed  and  the  associated  data  and  documen¬ 
tation  is  available  and  authorized. 

4.10.4  Inspection  and  Test  Records 

The  supplier  shall  establish  and  maintain  records  which  give 
evidence  that  the  product  has  passed  inspection  and/or  test 
with  defined  acceptance  criteria  (see  4.16). 

4.11  Inspection,  Measuring,  and  Tbst  Equipment 

The  supplier  shall  control,  calibrate,  and  maintain  inspec¬ 
tion.  measuring,  and  test  equipment,  whether  owned  by  the 


supplier,  on  loan,  or  provided  by  the  purchaser,  to  demon¬ 
strate  the  conformance  of  product  to  the  specified  require¬ 
ments.  Equipment  shall  be  used  in  a  manner  which  ensures 
that  measurement  uncertainty  is  known  and  is  consuaent  with 
the  required  measurement  capability. 

The  supplier  shall: 

a)  identify  the  measurements  to  be  made,  the  accuracy  re¬ 
quired,  and  select  the  appropriate  inspection,  measuring, 
and  test  equipment; 

b)  identify,  calibrate,  and  adjust  all  inspection,  measuring  and 
test  equipment,  and  devices  that  can  affect  product  quali¬ 
ty  at  prescribed  intervals,  or  prior  to  use,  against  certified 
equipment  having  a  known  valid  relationship  to  national¬ 
ly  recognized  standards  —  where  no  such  standards  exist, 
the  basis  used  for  calibration  shall  be  documented; 

c)  establish,  document,  and  maintain  calibration  procedures, 
including  details  of  equipment  type,  identification  number, 
location,  frequency  of  checks,  check  method,  acceptance 
criteria,  and  the  action  to  be  taken  when  results  are  un¬ 
satisfactory; 

d)  ensure  that  the  inspection,  measuring,  and  lest  equipment 
is  capable  of  the  accuracy  and  precision  necessary; 

e)  identify  inspection,  measuring,  and  test  equipment  with 
a  suitable  indicator  or  approved  identification  record  to 
show  the  calibration  status; 

f)  maintain  calibration  records  fix  inspection,  measuring,  and 
test  equipment  (see  4.16); 

g)  assess  and  document  the  validity  of  previous  inspection 
and  test  results  when  inspection,  measuring,  and  test  equip¬ 
ment  is  found  to  be  out  of  calibration; 

h)  ensure  that  the  environmental  conditions  are  suitable  for 
the  calibrations,  inspections,  measurements,  and  tests  be¬ 
ing  carried  out; 

i)  ensure  that  the  handling,  preservation,  and  storage  of  in¬ 
spection,  measuring,  and  test  equipment  is  such  that  the 
accuracy  and  fitness  for  use  is  maintained; 

j)  safeguard  inspection,  measuring,  and  lest  facilities,  in¬ 
cluding  both  test  hardware  and  test  software,  from  ad¬ 
justments  which  would  invalidate  the  calibration  setting. 

Where  test  hardware  (e.g.,  jigs,  fixtures,  templates,  patterns) 
or  test  software  is  used  as  suitable  forms  of  inspection,  they 
shall  be  checked  to  prove  that  they  are  capable  of  verifying 
the  acceptability  of  product  prior  to  release  for  use  during 
production  and  installation  and  shall  be  rechecked  at  pre¬ 
scribed  intervals.  The  supplier  shall  establish  the  extent  and 
frequency  of  such  checks  and  shall  maintain  records  as 
evidence  of  control  (see  4.16).  Measurement  design  data  shall 
be  made  available,  when  required  by  the  purchaser  or  his 
representative,  for  verification  that  it  is  functionally  adequate. 
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4.12  Inspection  and  Test  States 

The  inspection  and  test  status  of  product  shall  be  identified 
by  using  markings,  authorized  stamps,  tags,  labels,  routing 
cards,  inspection  records,  test  software,  physical  location,  or 
other  suitable  means,  which  indicate  the  conformance  or  non¬ 
conformance  of  product  with  regard  to  inspection  and  tests 
performed.  The  identification  of  inspection  and  test  status 
shall  be  maintained,  as  necessary,  throughout  production  and 
installation  of  the  product  to  ensure  that  only  product  that 
has  passed  the  required  inspections  and  tests  is  dispatched, 
used,  or  installed. 

Records  shall  identify  the  inspection  authority  responsible 
for  the  release  of  conforming  product  (see  4.16). 

4.13  Control  of  Nonconforming  Product 

The  supplier  shall  establish  and  maintain  procedures  to  en¬ 
sure  that  product  that  does  not  conform  to  specified  re¬ 
quirements  is  prevented  from  inadvertent  use  or  installation. 
Control  shall  provide  for  identification,  documentation, 
evaluation,  segregation  when  practical,  disposition  of  non¬ 
conforming  product,  and  for  notification  to  the  functions 
concerned. 

4.13.1  Nonconformity  Review  and  Disposition 

The  responsibility  for  review  and  authority  for  the  disposi¬ 
tion  of  nonconforming  product  shall  be  defined. 

Nonconforming  product  shall  be  reviewed  in  accordance  with 
documented  procedures.  It  may  be: 

a)  reworked  to  meet  the  specified  requirements,  or 

b)  accepted  with  or  without  repair  by  concession,  or 

c)  re-graded  for  alternative  applications,  or 

d)  rejected  or  scrapped. 

Where  required  by  the  contract,  the  proposed  use  or  repair 
of  product  (see  4.13.1  b)  which  does  not  conform  to  specified 
requirements  shall  be  repotted  for  concession  to  the  purchaser 
or  the  purchaser's  representative.  The  description  of  noncon¬ 
formity  that  has  been  accepted,  and  of  repairs,  shall  be  re¬ 
corded  to  denote  the  actual  condition  (see  4.16). 

Repaired  and  reworked  product  shall  be  re-inspected  in  ac¬ 
cordance  with  documented  procedures. 

4.14  Corrective  Action 

The  supplier  shall  establish,  document,  and  maintain  pro¬ 
cedures  for: 

a)  investigating  the  cause  of  nonconforming  product  and  the 
corrective  action  needed  to  prevent  recurrence; 

b)  analyzing  all  processes,  work  operations,  concessions, 


quality  records,  service  reports,  and  customer  complain 
to  detect  and  eliminate  potential  causes  of  nonconforming 
product; 

c)  initiating  preventative  actions  to  deal  with  problems  to  a 
level  corresponding  to  the  risks  encountered; 

d)  applying  controls  to  ensure  that  corrective  actions  are  taken 
and  that  they  are  effective; 

e)  implementing  and  recording  changes  in  procedures  result¬ 
ing  from  corrective  action. 

4.15  Handling,  Storage,  ftckaging,  and  Delivery 

4.15.1  General 

The  supplier  shall  establish,  document,  and  maintain  pro¬ 
cedures  for  handling,  storage,  packaging,  and  delivery  of 
product. 

4.15.2  Handling 

The  supplier  shall  provide  methods  and  means  of  handling 
that  prevent  damage  or  deterioration. 

4.153  Storage 

The  supplier  shall  provide  secure  storage  areas  or  slock  rooms 
to  prevent  damage  or  deterioration  of  product,  pending  use, 
or  delivery.  Appropriate  methods  for  authorizing  receipt  and 
the  dispatch  to  and  from  such  areas  shall  be  stipulated.  In 
order  to  detect  deterioration,  the  condition  of  product  in  stock 
shall  be  assessed  at  appropriate  intervals. 

4.15.4  Packaging 

The  supplier  shall  control  packing,  preservation,  and  mark¬ 
ing  processes  (including  materials  used)  to  the  extent 
necessary  to  ensure  conformance  to  specified  requirements 
and  shall  identify,  preserve,  and  segregate  all  product  from 
the  time  of  receipt  until  the  supplier's  responsibility  ceases. 

4.15.5  Delivery 

The  supplier  shall  arrange  for  the  protection  of  the  quality 
of  product  after  final  inspection  and  test.  Where  contractually 
specified,  this  protection  shall  be  extended  to  include  delivery 
to  destination. 

4.16  Qualify  Records 

The  supplier  shall  establish  and  maintain  procedures  for  iden¬ 
tification.  collection,  indexing,  filing,  storage,  maintenance, 
and  disposition  of  qualify  records. 

Quality  records  shall  be  maintained  to  demonstrate  achieve¬ 
ment  of  the  required  quality  and  the  effective  operation  of 
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the  quality  system.  Pertinent  sub-contractor  quality  records 
shall  be  an  element  of  these  data. 

All  quality  records  shall  be  legible  and  identifiable  to  the 
product  involved.  Quality  records  shall  be  stored  and  main¬ 
tained  in  such  a  way  that  they  are  readily  retrievable  in 
facilities  that  provide  a  suitable  environment  to  minimize 
deterioration  or  damage  and  to  prevent  loss.  Retention  times 
of  quality  records  shall  be  established  and  recorded.  Where 
agreed  contractually,  quality  records  shall  be  made  available 
for  evaluation  by  the  purchaser  or  the  purchaser’s  represen¬ 
tative  for  an  agreed  period. 

4.17  Internal  Quality  Audits 

The  supplier  shall  carry  out  a  comprehensive  system  of  plan¬ 
ned  and  documented  internal  quality  audits  to  verify  whether 
quality  activities  comply  with  planned  arrangements  and  to 
determine  the  effectiveness  of  the  quality  system. 

Audits  shall  be  scheduled  on  the  basis  of  the  status  and  im¬ 
portance  of  the  activity. 

The  audits  and  follow-up  actions  shall  be  carried  out  in  ac¬ 
cordance  with  documented  procedures. 

The  results  of  the  audits  shall  be  documented  and  brought 
to  the  attention  of  the  personnel  having  responsibility  in  the 


area  audited.  The  management  personnel  responsible  for  die 
area  shall  take  timely  corrective  action  on  the  deficiencies 
found  by  the  audit  (see  4.1.3). 

4.10  Training 

The  supplier  shall  establish  and  maintain  procedures  for  iden¬ 
tifying  the  training  needs  and  provide  for  the  training  of  all 
personnel  performing  activities  affecting  quality.  Personnel 
performing  specific  assigned  tasks  shall  be  qualified  on  the 
basis  of  appropriate  education,  training,  and/or  experience, 
as  required.  Appropriate  records  of  training  shall  be  main¬ 
tained  (see  4.16). 

4.19  Servicing 

Where  servicing  is  specified  in  the  contract,  the  supplier  shall 
establish  and  «n»int»in  procedures  for  performing  and  veri¬ 
fying  that  servicing  meets  the  specified  requirements. 

4.20  Statistical  Techniques 

Where  appropriate,  the  supplier  shall  establish  procedures 
for  identifying  adequate  statistical  techniques  required  for 
verifying  the  acceptability  of  process  capability  and  product 
characteristics. 
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Guidelines  for  ISO  9000  Quality 
Standards  in  USACE 


The  ISO  9000  quality  assurance  standards  were  intentionally  designed  to  be 
unrestrictive.  They  set  broad  guidelines  for  what  the  basic  elements  of  a  quality 
management  system  need  to  be,  but  they  give  organizations  a  great  deal  of  flexi¬ 
bility  in  how  they  carry  out  their  quality  processes.  They  do  not  mandate  how 
activities  should  be  done.  The  following  sections  translate  each  of  the  20  ISO 
9001  quality  assurance  standards  as  they  would  apply  to  a  typical  U.S.  Army 
Corps  of  Engineers  (USACE)  field  activity.  (The  numerals  in  parentheses  after 
each  major  heading  refer  to  the  appropriate  section  of  the  ISO  9001  standards  as 
given  in  Appendix  B.)  Following  die  brief  description,  a  set  of  guidelines  shows 
what  USACE  field  activities  need  to  address  to  meet  the  intention  of  each  stan¬ 
dard. 


Management  Responsibiuty  (4.1) 

Description 


Requires  the  USACE  engineering  organization  to  establish,  define,  and 
document  its  quality  policy  and  objectives  and  demonstrate  its  commitment  to 
quality  engineering  processes  and  products.  Management  must  ensure  that 
those  policies  and  objectives  are  understood,  implemented,  and  maintained  at 
all  levels  of  the  organization  by  all  personnel  directly  affecting  its  quality  engi¬ 
neering  and  design  products. 

Ultimately,  a  single  person  within  die  engineering  organization  needs  to  be 
vested  with  the  overall  responsibility  for  the  organization's  quality  efforts  and 
ISO  9000  compliance.  The  overall  objective  of  that  function  is  to  make  sure  engi¬ 
neering  products  meet  the  customer  requirements  for  technical  sufficiency, 
costs,  and  schedule. 


Guidelines  for  Conformity 

y  Within  the  engineering  organization,  have  quality  and  quality  management 
policies,  goals,  and  objectives  been  defined  and  are  they  well-documented? 

'J  Are  procedures  in  place  to  ensure  they  are  effectively  communicated  and 
understood  by  everyone  at  the  district? 
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y  Has  management's  commitment  to  those  policies  and  objectives  been  de¬ 
fined? 

^  Have  those  policies  been  communicated  to  customers  and  suppliers? 

</  Has  a  distinct  group  or  single  person  within  the  engineering  organization 
been  charged  with  overall  responsibility  for  the  quality  initiative  and  for  en¬ 
suring  that  all  ISO  9000  requirements  are  implemented  and  maintained? 
And,  is  that  appointment  recorded  in  the  quality  manual? 

Does  the  management  representative  have  sufficient  authority  to  develop, 
monitor,  and  change  elements  of  the  quality  system? 

J  Is  the  quality  system  periodically  reviewed  to  ensure  its  continuing  suitabil¬ 
ity  and  effectiveness,  and  are  records  of  those  reviews  maintained? 

<J  Are  all  district  personnel  adequately  trained  in  the  district's  quality  man¬ 
agement  program  and  Total  Army  Quality  (TAQ)? 

7  Has  the  engineering  organization  defined  the  responsibilities  and  authori¬ 
ties  of  persons  involved  in  design  review  and  internal  quality  audits  as  well 
as  persons  involved  in  the  identification  and  recording  of  any  quality  prob¬ 
lems? 


Quality  System  (4.2) 

Description 


Requires  the  engineering  organization  to  implement  and  to  document  an  ef¬ 
fective  quality  system  that  ensures  engineering  and  design  (E&D)  activities  con¬ 
form  to  management's  requirements  for  quality.  The  quality  system,  which 
must  be  well-documented  and  assure  the  engineering  organization's  product 
and  service  meet  customer  requirements,  consists  of 

♦  a  quality  manual  that  addresses  all  levels  of  ISO  9000  series  standards; 

♦  documented  procedures,  work  instructions,  test  procedures,  and  review 
procedures  supporting  the  specifications  contained  in  the  quality  manual 
for  all  E&D  activities;  and 

♦  preparation  of  a  quality  plan  for  all  new  projects  that  documents  customer 
requirements  and  shows  how  those  requirements  will  be  met 

The  quality  system  manual  must  include 

♦  the  district  engineer's  (or  designee)  signature. 
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♦  the  district' s  name  and  location, 

4  the  district's  quality  policy, 

4  current  organizational  charts, 

4  designated  quality  responsibilities, 

4  accepted  management  review  system, 

4  approved  methods  for  revising  and  updating  the  manual,  and 
4  complete  coverage  of  all  quality  system  elements. 


Guidelines  for  Conformity 

y  Does  the  engineering  organization  have  a  quality  manual  that  fully  docu¬ 
ments  its  quality  management  system,  and  is  that  manual  in  a  form  that  is 
readily  accessible  and  understood  by  all  employees? 

y  Does  the  quality  manual's  stated  quality  system  cover 

►  preparation  of  project  quality  control  plans; 

►  identification  and  acquisition  of  controls,  processes,  inspection  and  test¬ 
ing  equipment,  design  resources,  and  skills  needed  to  achieve  the  re¬ 
quired  quality; 

►  identification  of  any  measurement  requirement  involving  capability 
that  exceeds  foe  known  state  of  foe  art; 

►  clarification  of  standards  for  acceptability  of  engineering  and  design 
products; 

4  compatibility  of  foe  design,  design  processes,  and  review  and  approval 
procedures;  and 

►  identification  and  maintenance  of  quality  records? 

7  Has  foe  engineering  organization  established  and  documented  procedures 
for  preparing  quality  and  quality  control  plans  in  accordance  with  foe  dis¬ 
trict'  s  specific  customer  requirements? 

7  Has  foe  engineering  organization  established  and  documented  procedures 
for  updating,  as  necessary,  quality  control  and  design  review  techniques? 
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V  Has  the  engineering  organization  established  and  documented  procedures 
for  verifying  compatibility  of  the  design  products  to  its  intended  initial 
requirements  —  in  other  words,  ensuring  the  customer  gets  what  it  wants? 

Are  adequate  procedures  in  place  to  ensure  compliance  with  the  other  es¬ 
tablished  quality  system,  for  example,  TAQ  and  the  Automated  Review 
Management  System  (ARMS)? 

J  Does  the  TAQ  initiative,  as  it  is  being  implemented  at  the  district,  comply 
with  every  element  of  the  ISO  9000  standards? 


Contract  Review  (Customer  Requirements  Review) 

(4.3) 

Description 


For  all  memorandums  of  agreement  (MOAs),  memorandums  of  under¬ 
standing  (MOUs),  and  customer  contracts,  the  engineering  organization  is  re¬ 
quired  to  establish  a  contract  review  system  that 

♦  ensures  that  all  the  customers'  requirements  are  adequately  defined,  docu¬ 
mented,  and  effectively  communicated  to  the  engineering  organization; 

♦  effectively  resolves  differences  with  customers'  requirements  when  they 
arise; 

♦  ensures  that  it  is  capable  of  meeting  the  customers'  requirements  before  en¬ 
tering  into  an  agreement  for  E&D  activities;  and 

♦  keeps  records  of  all  above-related  transactions  (see  records  management  at 
4.16). 


Guidelines  for  Conformity 

V  Has  the  engineering  organization  established,  written,  and  reviewed  its  pro¬ 
cedures  to  ensure  that  all  customer  requirements  are  adequately  defined 
and  documented  (e.g.,  PBs,  PDBs,  and  DD  1391s)? 

y  Has  the  engineering  organization  established  and  written  procedures  for  re¬ 
solving  conflicts  with  its  customers  and  contractors? 

V  Has  the  engineering  organization  established  and  written  procedures  to  en¬ 
sure  its  contractors  or  in-house  staff  has  the  capability  of  meeting  the  cus¬ 
tomers'  stated  requirements? 
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V  Are  records  of  all  reviews  maintained,  and  are  persons  conducting  those  re¬ 
views  identified? 


Design  Control  (Planning)  (4.4) 

Description 


Requires  that  die  engineering  organization  establish  and  maintain  proce¬ 
dures  to  control  and  verify  that  E&D  products  meet  die  requirements  specified 

by  the  customers,  internal  policy,  and  Army  regulation.  This  requires  the  design 

planning  system  to 

♦  establish  a  framework  for  initial  design  planning  activities  (e.g.,  project 
management  plan); 

♦  show  how  designs  are  initiated,  and  updated; 

♦  effectively  plan  who  will  execute  the  design  (in  house  or  A-E  contractor); 

♦  identify  technical  and  informational  interfaces  between  various  engineering 
activities  (e.g.,  determining  who  is  in  charge  of  what); 

♦  establish  responsibilities  and  procedures  for  identifying,  documenting,  veri¬ 
fying,  and  resolving  ambiguous  or  conflicting  design  requirements; 

♦  establish  procedures  for  ensuring  completed  designs  conform  to  safety, 
functional,  regulatory,  standard  designs,  and  requirements  from  architec¬ 
tural  and  engineering  instructions; 

♦  assign  design  review  and  approval  responsibilities; 

♦  establish  procedures  for  identifying,  documenting,  and  periodically  review¬ 
ing  all  design  changes  and  modifications; 

♦  establish  a  link  between  customer  requirements,  costs,  and  the  E&D  serv¬ 
ices  provided;  and 

♦  establish  biddability,  constructability,  and  operability  review  procedures. 


Guidelines  for  Conformity 

V  Are  plans  developed  that  identify  foe  responsibility  of  each  distinct  activity 
involved  in  foe  project? 

'J  Are  foe  project  management  plans  updated  as  foe  project  evolves? 
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y  Is  the  project  schedule  adequately  developed,  and  are  the  various  project 
activities  assigned  to  qualified  personnel  equipped  with  adequate  resources 
to  effectively  complete  it? 

yj  Are  organization  and  technical  interfaces  between  different  groups  identi¬ 
fied,  documented,  and  reviewed  regularly? 

y/  Are  die  cognizant  engineering  organization's  personnel  notified  of  changes 
as  the  project  evolves? 

V  Are  customer  requirements  defined  and  incorporated  during  the  design  de¬ 
velopment  process?  Are  adequate  control  mechanisms  in  place  to  ensure 
that  they  are  met? 

V  Are  procedures  in  place  for  resolving  incomplete,  ambiguous,  or  conflicting 
requirements  with  those  responsible  for  meeting  the  requirement? 

V  Are  procedures  established  for  capturing  lessons  learned,  and  are  they 
documented  and  freely  distributed  to  others  within  die  engineering  organi¬ 
zation? 

7  Are  persons  other  than  those  on  the  project  team  responsible  for  the  review 
and  verification  of  the  designs? 

y/  Are  the  results  of  projects  recorded  and  properly  filed  for  future  reference 
(for  developing  other  project  management  plans)? 

y/  Are  the  project  management  plans  checked  to  ensure  they  do  not  conflict 
with  the  customers'  initial  requirements? 

y/  Are  procedures  adequate  for  identifying,  documenting,  reviewing,  and  ap¬ 
proving  all  potential  changes  and  modifications  to  the  projects? 

y/  Are  procedures  in  place  for  meeting  biddability,  constructability,  and  oper¬ 
ability  requirements? 

y/  Are  USACE  systems  such  as  Automated  Management  and  Progress  Report¬ 
ing  System  and  Corps  of  Engineers  Management  Information  System  used 
effectively? 


Document  Control  (4.5) 

Description 

Requires  the  engineering  organization  to  establish  and  maintain  an  effective 
document  control  system  that  includes  procedures  for  creating,  controlling,  re¬ 
viewing,  approving,  and  publishing 


♦  all  Army  and  USACE  regulations,  pamphlets,  circulars,  and  technical  notes; 

♦  the  organization's  ISO  quality  manual; 

♦  engineering  organization  standing  operating  procedures  (SOPs); 

♦  design  criteria; 

♦  standard  designs; 

♦  ISO-related  quality  documentation;  and 

♦  in-process  and  completed  designs  (and  related  documentation). 

The  document  control  system  must  also  establish  and  maintain  procedures 
for  changes  and  modifications  to  all  related  documentation  including,  how 
changes  are  identified  on  the  documents,  how  revisions  are  made  and  identified, 
and  how  many  revisions  are  allowed  before  a  document  or  design  must  be  reis¬ 
sued. 


Guidelines  for  Conformity 

'J  Are  mechanisms  in  place  for  controlling  the  issue  and  review  of  all  perti¬ 
nent  plans  and  designs,  SOPs,  regulations,  architectural  and  engineering  in¬ 
structions  (AEIs),  design  criteria,  design  standards,  ISO-related  quality 
plans,  and  other  documents? 

y  Are  effective  procedures  in  place  for  ensuring  the  identification, 
documentation,  and  appropriate  review  and  approval  of  all  design  changes 
and  modifications? 

Are  design  changes  reviewed  and  approved  by  the  same  activities  that  per¬ 
form  the  original  review? 

'J  Before  being  entered  into  the  system,  are  all  documents  checked  for  appro¬ 
priate  levels  of  review  and  approvals? 

V  Does  a  master  list  of  all  essential  documentation  exist  to  ensure  that  the 
most  up-to-date  documents  are  in  place  where  they  are  needed  and  to  en¬ 
sure  that  outdated  or  nonapplicable  documents  are  never  used? 

7  Is  that  master  list  kept  current? 

/  Do  the  design  reviewers  and  approvers  have  access  to  the  relevant  docu¬ 
mentation  and  design  information  in  order  to  effectively  perform  their  func¬ 
tions?  (For  example,  is  ARMS  used?) 
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<J  Is  there  a  policy  for  reissuing  documents  after  a  certain  number  of 
revisions/  changes? 

/  Are  all  outdated  or  obsolete  documents  removed  from  the  system  as  well  as 
at  points  of  use? 

J  Does  a  control  mechanism  for  temporary  changes  or  updates  exist? 

Purchasing  (4.6) 

Description 

Requires  die  engineering  organization  to  ensure  that  all  purchased  supplies, 
materials,  and,  especially,  architect-engineering  (A-E)  services  conform  to  pre- 
established  requirements.  To  do  so,  all  A-E  contractors  must  be  selected  on  their 
ability  to  meet  contract  (customer)  requirements.  Also,  USACE  must  establish 
and  maintain  records  of  successful  and  unsuccessful  A-E  contractors  (e.g.,  utilize 
die  ACASS).  In  addition,  customers  must  be  able  to  verify  that  their  require¬ 
ments  can  be  met  by  those  services  contracted  to  outside  A-E  firms. 


Guidelines  for  Conformity 

y  Do  specifications  exist  for  all  goods  and  services  (including  A-E  services) 
purchased  or  contracted  by  tile  district? 

/  Is  there  a  system  in  place  to  ensure  that  all  purchased  goods  and  services 
conform  to  those  specifications? 

V  Are  A-E  contractors  selected  on  die  basis  of  their  ability  to  meet  those  stated 
requirements,  including  any  additional  quality  requirements  established  by 
die  ISO  standards? 

V  Do  you  currently  evaluate  the  quality  system  of  your  A-E  contractors  or 
suppliers,  and  is  die  quality  system  evaluated  based  on  past  experience, 
evaluation  or  previous  work,  on  site  visits,  and/or  their  registration  under 
die  ISO  or  similar  standards? 

/  Is  a  list  of  qualified  A-E  contractors  kept  and  maintained,  and  are  those 
records  examined  during  A-E  selection  and  price  negotiations? 

J  Are  contracts,  purchase  orders,  and  delivery  orders  always  reviewed  to  en¬ 
sure  they  contain  die  necessary  requirements? 

V  Are  A-E  contractors  ISO-registered  (not  mandatory)? 
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J  Is  there  a  mechanism  in  place  to  ensure  that  USACE's  customers  can  verify 
that  their  requirements  are  met  by  the  A-E  contractor? 


Purchaser  (Customer)-Supplied  Product  (4.7) 

Description 


Requires  the  engineering  organization  to  establish  control  procedures,  in¬ 
cluding  recordkeeping,  relating  to  verification,  storage,  and  maintenance  of  any 
materials  or  products  supplied  by  the  customers  that  are  used  for  developing  its 
engineering  and  design  products. 


Guidelines  for  Conformity 

✓  Are  customers'  as-built  drawings,  installation  plans,  procedure  and  operat¬ 
ing  manuals,  and/or  preliminary  design  documents  effectively  controlled 
while  they  are  being  used  and,  if  requested,  are  they  returned  to  die  cus¬ 
tomers  when  the  project  is  complete? 

7  Does  the  engineering  organization  keep  records  of  user-generated  request 
for  proposals  (RFP)  packages  so  drey  can  be  used  again  if  similar  work  from 
die  same  customer  is  necessary? 


Product  Identification  and  Traceability  (4.8) 

Description 


Requires  the  engineering  organization  to  establish  a  system  to  ensure  that 
engineering  and  design  products  are  uniquely  identified  and  traceable  through 
all  stages  of  die  design  development  process.  If  errors  in  die  end  product  are 
discovered,  the  designs  must  be  identified  adequately  enough  at  various  stages 
to  perform  an  effective  audit  of  the  causes  of  the  problems. 


Guidelines  for  Conformity 

V  Are  all  designs  and  products  associated  with  those  designs  adequately  and 
uniquely  identified? 

V  Is  a  system  in  place  to  ensure  those  products  and  related  support  documen¬ 
tation  are  traceable? 
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Process  Control  (4.9) 

Description 


Requires  the  engineering  organization  to  identify  and  plan  die  E&D  devel¬ 
opment  processes  /  activities  that  directly  affect  die  quality  of  die  finished  prod¬ 
uct  In  addition,  those  processes/activities  must  be  carried  out  in  controlled 
conditions  that  include 

4  documenting  work  instructions  that  define  methods  of  E&D  development; 
use  of  suitable  equipment;  suitable  work  environments;  compliance  with 
applicable  codes,  regulations,  standards,  and  AEI;  and  quality  plans; 

4  monitoring  and  controlling,  during  design  development,  suitable  processes; 
applicable  laws,  regulations,  codes,  design  criteria,  and  standards;  and  final 
design  characteristics; 

4  developing  criteria  for  acceptable  levels  of  workmanship; 

4  identifying  appropriate  points  during  design  development  for  viewing  and 
verifying  quality  elements  and  approving  continuation  in  die  process. 

Documented  work  instructions  should  include 

4  methods  of  work  accomplishment 

4  tools  needed  to  perform  the  tasks, 

4  sequences  of  activities, 

4  monitoring  requirements, 

4  necessary  inspection  and  test  requirements, 

4  standard  designs  used  when  and  where  appropriate,  and 

4  sampling  requirements,  where  appropriate 


Guidelines  for  Conformity 

7  Have  adequate  procedures  and  work  instructions  been  established  on  how 
to  perform  all  activities  associated  with  design  development?  For  example, 
critical  path  activity  networks  or  process/  activity  modeling  would  be  ap¬ 
propriate  means  for  establishing  and  documenting  all  such  procedures. 
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V  Is  a  critical  path  network  of  design  activities  established,  and  are  those  criti¬ 
cal  activities  monitored  during  the  design  development  process? 

y  Do  standards  for  what  constitutes  acceptable  performance  exist  in  relation 
to  performance  of  design  activities? 

J  Do  USACE  personnel  know  what  variables  in  the  design  process  are  impor¬ 
tant  to  achieve  excellent  quality? 

y  Are  detailed  process  instructions  and  procedures  established  and  well- 
documented,  and  are  they  easily  understood  by  those  that  must  use  them? 


Inspection  and  Testing  (4.10) 

Description 


Requires  die  engineering  organization  to  establish  and  document  systems 
and  procedures  for  effectively  inspecting  and  testing  all  incoming  products  from 
outside  contractors  and  vendors,  all  in-process  E&D  activity,  and  all  final  E&D 
products  in  preparation  for  delivery  to  the  customers. 


Guidelines  for  Conformity 

y  Is  there  a  system  in  place  to  ensure  the  quality  of  design  work  contracted  to 
outside  A-E  firms  and  other  purchased  services? 

J  Are  inspection  and  review  procedures  performed  in  accordance  with  the 
quality  plan  and  other  documented  procedures? 

'J  Are  nonconforming  plans  and  designs  identified,  and  does  the  system  pro¬ 
vide  procedures  for  rejecting  unacceptable  work? 

V  Are  procedures  in  place  for  reviewing  and  approving  in-process  designs, 
and  do  those  procedures  handle  the  rejection  of  in-process  work? 

y  Are  all  designs  released  only  after  a  final  review  confirms  fruit  release  of  the 
designs  and  other  products  is  acceptable? 

y  Are  records  maintained  showing  that  designs  have  passed  final  reviews, 
what  the  final  review  criteria  were,  and  who  authorized  their  release? 
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Inspection,  Measuring,  and  Test  Equipment  (4.11) 

Description 


Requires  the  engineering  organization  to  establish  and  document  proce¬ 
dures  and  systems  for  ensuring  the  accuracy  and  precision  of  all  measuring  and 
testing  equipment  used  for  ensuring  designs  conform  to  pre-established  require¬ 
ments  during  the  design  development  process. 


Guidelines  for  Conformity 

y/  Are  engineering  test  equipment  (e.g.,  electronic  survey,  soils  analysis,  sur¬ 
vey  boat  equipment,  and  nuclear  densometers)  properly  controlled  and  pe¬ 
riodically  calibrated? 

yf  Are  engineering  computer  models  periodically  reviewed  and  updated  as 
the  model  assumptions,  boundaries,  and  analytic  data  change? 

y/  Are  records  of  calibrations,  the  results,  accuracy  and  precision,  and  the 
status  of  the  equipment  kept  and  maintained? 


Inspection  and  Test  Status  (4.12) 

Description 


Requires  the  engineering  organization  to  establish  and  document  systems 
and  procedures  for  ensuring  that  E&D  products  are  suitably  identified  according 
to  their  last  review  and  inspection  status  throughout  the  design  development 
process.  In  addition,  the  inspection  authority  responsible  for  releasing  finished 
designs  must  be  recorded. 


Guidelines  for  Conformity 

7  Are  conforming  and  nonconforming  design  work  so  marked  to  indicate 
their  current  status,  and  do  other  design  and  engineering  personnel  have 
access  to  and  know  what  that  status  is  of  in-process  work? 

y  Do  those  personnel  who  utilize  contracted  work  know  what  its  quality  is  or 
its  level  of  acceptability? 

y  Do  personnel  know  who  is  able  to  release  conforming  work  or  reject  unac¬ 
ceptable  work? 
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<J  Is  a  system  in  place  for  releasing  acceptable  products? 

y  Are  adequate  records  kept  to  indicate  die  status  and  inspection  authority  re¬ 
sponsible  for  releasing  finished  designs? 


Control  of  Nonconforming  Product  (4.13) 

Description 


Requires  title  engineering  organization  to  put  systems  and  procedures  in 
place  for  identifying  and  controlling  all  design  breakage  and/or  design  rejec¬ 
tions  so  that  design  products  with  identified  errors  never  reach  die  customer. 
Procedures  must  be  documented  and  maintained. 


Guidelines  for  Conformity 

y  Does  die  engineering  organization  identify  and  segregate  unacceptable  de¬ 
sign  work  and  ensure  unacceptable  work  is  never  released  to  its  customers? 

y  Are  adequate  records  kept  indicating  die  disposition  of  unacceptable  work? 

V  Is  a  procedure  emplaced  or  a  special  area  within  the  engineering  activity 
designated  for  handling  unacceptable  work? 

7  Is  a  procedure  in  place  for  reworking  unacceptable  work  and  making  it 
comply  with  the  appropriate  standards  and/or  the  customer's  require¬ 
ments? 

y  Is  a  procedure  in  place  for  notifying  customers  of  unacceptable  work  and 
how  that  work  will  be  disposed  or  reworked  to  conformance? 

y  Are  reworked  designs  reviewed  for  conformance  to  criteria  and  customer 
requirements? 


Corrective  Action  (4.14) 

Description 


Requires  the  engineering  organization  to  establish  procedures  to  document 
and  keep  records  of  design  errors  to 

♦  investigate  causes  of  inadequate  design  work  and  implement  corrective  ac¬ 
tions  that  will  prevent  recurrences  [for  example,  use  of  the  Engineering  Im¬ 
provement  Recommendation  System  (EIRS)]; 
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♦  research  relevant  quality  records,  customer  complaints,  design  criteria, 
SOPs,  standard  designs,  etc.,  to  detect  and  eliminate  potential  causes  of  un¬ 
acceptable  design  products; 

♦  verify  that  corrective  actions  have  been  initiated  and  evaluate  their  effects 
on  future  products;  and 

♦  ensure  that  the  necessary  procedural  changes  have  been  implemented  and 
recorded  as  a  result  of  corrective  actions. 


Guidelines  for  Conformity 

y  When  work  is  found  to  be  unacceptable,  is  the  nature  and  cause  of  the  defi¬ 
ciency  identified? 

y  Are  corrective  actions  taken  to  preclude  recurrences  of  common  problems? 

y  Are  procedures  available  for  following  up  on  corrective  actions  taken? 

y  Does  the  engineering  organization  verify  that  corrective  actions  taken  are 
effective  by  analyzing  risk  versus  reward  or  return  on  investment? 

y  Are  systems  and  procedures  ever  changed  as  the  result  of  such  corrective 
actions? 

7  Is  a  system  available  to  detect  and  prevent  problem  areas? 

y  Has  the  engineering  activity  prepared  a  form  designated  for  corrective  ac¬ 
tions,  and  are  those  forms  logged  and  maintained? 

Handling,  Storage,  Packaging,  and  Delivery 

(4.15) 

Description 


Requires  the  engineering  organization  to  establish  and  document  proce¬ 
dures  to  properly  handle,  store,  retrieve,  and  package  E&D  project  materials  in 
house,  and  deliver  finished  products  to  its  customers.  Elements  of  that  system 
should  include 

♦  secured  storage  (whether  physical  storage  or  in  electronic  format)  to  protect 
in-process  designs  from  theft,  deterioration,  misuse,  or  unauthorized  revi¬ 
sion  and 

♦  use  of  reproduction  systems  to  ensure  that  customers  get  die  quantity  of  de¬ 
signs  needed  and  in  an  acceptable  condition. 


C-14 


Guidelines  for  Conformity 

V  Does  the  engineering  organization  maintain  procedures  for  the  effective 
handling,  storage,  packaging,  distribution,  and  delivery  of  in-process  and 
final  plans  and  designs? 

t/  Does  USACE  ensure  effective  means  of  handling  (for  example,  computer- 
aided  design  development  file  transfers)  its  product  to  minimize  risk  of 
damage  or  deterioration? 

J  Are  the  correct  number  of  copies  of  plans  and  specifications  prepared  to 
minimize  waste  but  satisfy  needs? 

^  Are  storage  locations  secure  to  prevent  damage,  deterioration,  or  theft? 

7  Can  stored  plans  and  designs  be  located  and  retrieved  easily? 

^  Are  procedures  in  place  for  effectively  packaging  and  delivering  finished 
designs  to  the  customer? 

^  Are  stored  designs  periodically  inspected  to  determine  obsolescence? 


Quality  Records  (4.16) 

Description 


Requires  the  engineering  organization  to  establish  and  document  proce¬ 
dures  for  creating,  keeping,  maintaining,  retaining,  distributing,  using,  and  dis¬ 
posing  of  all  records  that  affect  the  product's  quality  (for  example,  a  records 
management  system).  The  procedures  should  specify  persons  responsible  for 
the  records  management  system,  types  of  records  to  be  maintained,  system  se¬ 
curity,  retrieval  procedures,  retention  intervals,  means  of  disposal,  and  a  system 
for  making  quality  records  available  to  customers  and  auditors.  Quality  records 
should  at  a  minimum  consist  of 

♦  the  quality  manual  and  any  other  ISO  materials, 

♦  management  review  records, 

♦  project  management  plans, 

♦  project-specific  quality  control  plans, 

♦  contract  review  records, 

♦  design  review  records. 
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♦  process  control  records, 

♦  internal  quality  system  audits, 

♦  measuring  and  test  equipment  calibration  records, 

♦  personnel  training  records, 

♦  corrective  actions  records,  and 

♦  records  of  final  designs  and  any  other  E&D  related  products. 


Guidelines  for  Conformity 

7  Is  a  system  in  place  for  the  identifying,  collecting,  indexing,  filing,  storing, 
maintaining,  and  disposing  of  quality  records? 

/  Are  all  records  legible,  properly  identified,  and  marked? 

J  Are  records  easily  archived  and  retrievable? 

•J  Are  all  records  stored  in  such  a  way  to  preclude  damage  and/  or  deteriora¬ 
tion  over  time? 

/  Are  there  policies  for  retention  and  disposal? 

V  Where  agreed  contractually,  are  records  accessible  by  USACE  customers 
and  external  auditors? 


Internal  Quality  Audits  (4.17) 

Description 


Requires  the  engineering  organization  to  establish  a  comprehensive  and 
systematic  approach  to  quality  system  audits.  That  system  must  be  planned 
and  documented.  The  audits  must  be  carried  out  by  properly  trained  and 
authorized  personnel  whose  regular  responsibilities  are  outside  of  the  area  being 
audited.  They  must  be  effectively  scheduled,  and  records  of  the  findings  and 
follow-up  actions  must  be  maintained.  The  procedures  for  quality  audits  must 
make  sure  that  personnel  responsible  for  that  area  are  notified  of  the  deficiencies 
so  that  they  can  take  timely  corrective  action. 
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Guidelines  for  Conformity 

V  Are  independent  quality  audits  conducted  within  each  division,  branch,  or 
section  of  die  engineering  organization  to  verify  whether  quality  activities 
comply  with  established  procedures,  and  does  a  schedule  of  those  audits 
exist? 

<J  Are  internal  audits  conducted  in  accordance  with  die  established  proce¬ 
dures? 

J  Are  audits  performed  by  personnel  outside  of  the  functional  activity  being 
audited? 

V  Does  the  audit  body  communicate  the  results  of  those  audits  back  to  die 
cognizant  division,  branch,  and  section  managers? 

7  Are  corrective  actions  taken  as  the  result  of  the  audits,  and  are  those 
changes  effective? 

V  Have  the  internal  auditors  been  adequately  trained  to  perform  that 
function  —  preferably  through  ISO  9000  auditor  training  programs? 

7  Has  the  engineering  organization  generated  an  internal  audit  checklist  that 
recognizes  its  unique  design  development  process? 

J  Are  quality  audit  records  adequately  maintained,  and  are  those  records 
kept  at  least  until  the  next  audit  is  performed?  Are  audit  results  used  as  a 
basis  for  future  audits? 


Training  (4.18) 

Description 


Requires  the  engineering  organization  to  make  sure  all  its  personnel  are  ef¬ 
fectively  trained  to  carry  out  their  responsibilities  in  a  way  that  is  consistent  with 
the  documented  quality  system.  The  documented  training  program  should 
teach  quality  and  quality  management  issues  to  all  personnel  directly  affecting 
the  quality  of  E&D  products,  reconcile  needed  skills  with  skills  possessed  by 
every  member  of  the  organization,  be  adequately  funded,  evaluate  the  effective¬ 
ness  of  the  training,  and  conduct  post-training  assessments. 


Guidelines  for  Conformity 

V  Is  a  procedure  in  place  for  identifying  training  needs  for  all  personnel  per¬ 
forming  activities  affecting  engineering  and  design  quality? 
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V  Are  personnel  adequately  trained  in  terms  of  needed  skills  and  knowledge 
to  perform  their  jobs  effectively? 

y/  Do  training  records  exist  for  all  employees,  and  are  they  properly  main¬ 
tained? 

y/  Is  there  a  central  person  or  organizational  entity  that  maintains  individual 
training  records  and  programs? 

<1  Do  self-help  and  independent  training  aids  exist? 

y/  Does  the  training  program  cover  quality  awareness  for  all  USACE  person¬ 
nel  from  district  engineer  level  down? 

J  Does  the  training  program  cover  revisions  to  existing  procedures? 


Servicing  (4.19) 

Description 


Requires  the  engineering  organization  to  establish  and  document  proce¬ 
dures  for  providing  postdesign  services  appropriate  to  the  needs  of  its  custom¬ 
ers  such  as  legal,  contracting,  and  financial  closeout  Appropriate  records  of 
service-related  activities  should  be  maintained. 


Guidelines  for  Conformity 

y/  Are  procedures  established  for  providing  specified  services  to  the  custom¬ 
ers? 

y/  Where  required,  are  service  actions  meeting  USACE  customer  expectations? 

y/  Are  the  appropriate  USACE  personnel  trained  in  providing  "after  sales" 
services? 

y/  Does  the  engineering  organization  perform  periodic  reviews  of  completed 
construction  projects  to  ensure  that  specific  elements  function  as  they  were 
designed  and  intended? 
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Statistical  Techniques  (4.20) 

Description 

Requires  the  engineering  organization  to  establish  and  maintain  statistical 
techniques,  where  appropriate,  for  verifying  product  acceptability  during  design 
development,  process  control,  final  design  characteristics,  and  testing  and  qual¬ 
ity  control  equipment 


Guidelines  for  Conformity 

V  Are  appropriate  statistical  techniques  identified  and  used  to  determine  de¬ 
sign  process  capabilities,  product  characteristics,  nonconforming  product 
test  and  inspection  control,  process  control,  and  customer  complaints? 

J  Are  the  process  variables  and  their  effects  on  the  finished  product  under¬ 
stood? 

J  Are  those  statistical  techniques  properly  used  and  reviewed  for  consistency 
in  application? 

V  Are  die  appropriate  personnel  trained  in  die  use  and  analysis  of  those  tech¬ 
niques? 

V  Are  all  statistical  procedures  followed  and  kept  current? 
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